Sep 10 19:07:52 devstack cinder-volume[75029]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75029) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 19:07:52 devstack cinder-volume[75029]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75029) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 19:07:52 devstack cinder-volume[75029]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75029) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 19:07:53 devstack cinder-volume[75029]: INFO dbcounter [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Registered counter for database cinder
Sep 10 19:07:53 devstack cinder-volume[75029]: DEBUG oslo_db.sqlalchemy.engines [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75029) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 19:07:54 devstack cinder-volume[75029]: DEBUG dbcounter [-] [75029] Writer thread running {{(pid=75029) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 19:07:54 devstack cinder-volume[75029]: INFO cinder.rpc [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 10 19:07:54 devstack cinder-volume[75029]: INFO cinder.rpc [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 10 19:07:54 devstack cinder-volume[75029]: DEBUG oslo_db.sqlalchemy.engines [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75029) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 19:07:54 devstack cinder-volume[75029]: INFO cinder.volume.manager [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Determined volume DB was empty at startup.
Sep 10 19:07:54 devstack cinder-volume[75029]: DEBUG cinder.volume.manager [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75029) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 10 19:07:54 devstack cinder-volume[75029]: INFO cinder.volume.manager [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 10 19:07:54 devstack cinder-volume[75029]: WARNING stevedore.named [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 10 19:07:54 devstack cinder-volume[75029]: WARNING castellan.key_manager [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 19:07:54 devstack cinder-volume[75029]: WARNING cinder.keymgr.conf_key_mgr [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 19:07:54 devstack cinder-volume[75029]: DEBUG cinder.volume.drivers.lvm [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75029) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 10 19:07:54 devstack cinder-volume[75029]: DEBUG oslo_concurrency.processutils [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:07:55 devstack cinder-volume[75029]: DEBUG oslo_concurrency.processutils [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] CMD "cinder-rtstool verify" returned: 0 in 1.272s {{(pid=75029) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:07:55 devstack cinder-volume[75029]: DEBUG oslo_db.sqlalchemy.engines [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75029) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 19:07:56 devstack cinder-volume[75029]: INFO cinder.rpc [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 10 19:07:56 devstack cinder-volume[75029]: INFO cinder.rpc [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 10 19:07:56 devstack cinder-volume[75029]: WARNING stevedore.named [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 10 19:07:56 devstack cinder-volume[75029]: WARNING castellan.key_manager [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 19:07:56 devstack cinder-volume[75029]: INFO cinder.volume.manager [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_db.sqlalchemy.engines [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75029) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 19:07:56 devstack cinder-volume[75029]: INFO oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Starting 1 workers
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Started child 75129 {{(pid=75029) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Full set of CONF: {{(pid=75029) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] ******************************************************************************** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Configuration options gathered from: {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 10 19:07:56 devstack cinder-volume[75129]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] ================================================================================ {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] allow_availability_zone_fallback = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] allow_compression_on_image_upload = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] allowed_direct_url_schemes     = [] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] api_rate_limit                 = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] auth_strategy                  = keystone {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] az_cache_duration              = 3600 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_availability_zone      = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_host                   = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_name                   = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_stats_polling_interval = 60 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backup_api_class               = cinder.backup.api.API {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backup_name_template           = backup-%s {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backup_use_same_host           = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backup_use_temp_snapshot       = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] chap_password                  = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] chap_username                  =  {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cinder_internal_tenant_project_id = bd32b904acd64a5b9d65d4a0f3010663 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cinder_internal_tenant_user_id = 50fbc69f060840c787a61d1fbef59962 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cloned_volume_same_az          = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cluster                        = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] compression_format             = gzip {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] compute_api_class              = cinder.compute.nova.API {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] config_dir                     = [] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] config_source                  = [] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] control_exchange               = openstack {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] debug                          = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] default_availability_zone      = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] default_group_type             = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] default_volume_type            = lvmdriver-1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] driver_client_cert             = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] driver_client_cert_key         = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] driver_data_namespace          = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] driver_ssl_cert_path           = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] driver_ssl_cert_verify         = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] driver_use_ssl                 = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] enable_force_upload            = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] enable_new_services            = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] enable_unsupported_driver      = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] enforce_multipath_for_image_xfer = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] filter_function                = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] glance_api_insecure            = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] glance_api_servers             = ['http://192.168.122.168/image'] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] glance_api_ssl_compression     = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] glance_ca_certificates_file    = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] glance_catalog_info            = image:glance:publicURL {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] glance_certfile                = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] glance_keyfile                 = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] glance_num_retries             = 3 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] glance_request_timeout         = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] goodness_function              = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] graceful_shutdown_timeout      = 5 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] group_api_class                = cinder.group.api.API {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] host                           = devstack {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] image_compress_on_upload       = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] image_conversion_address_space_limit = 1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] image_conversion_cpu_limit     = 60 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] image_conversion_disable       = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] image_upload_use_cinder_backend = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] image_upload_use_internal_tenant = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] image_volume_cache_enabled     = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] image_volume_cache_max_count   = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] image_volume_cache_max_size_gb = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] init_host_max_objects_retrieval = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] instance_format                = [instance: %(uuid)s]  {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] iscsi_iotype                   = fileio {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] iscsi_target_flags             =  {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] iscsi_write_cache              = on {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] iser_helper                    = tgtadm {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] iser_ip_address                = 192.168.122.168 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] iser_port                      = 3260 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] log_color                      = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] log_config_append              = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] log_dir                        = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] log_file                       = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] log_options                    = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] log_rotate_interval            = 1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] log_rotate_interval_type       = days {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] log_rotation_type              = none {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] max_age                        = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] max_logfile_count              = 30 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] max_logfile_size_mb            = 200 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] max_over_subscription_ratio    = 20.0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] message_reap_interval          = 86400 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] message_ttl                    = 2592000 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] migration_create_volume_timeout_secs = 300 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] monkey_patch                   = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] monkey_patch_modules           = [] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] my_ip                          = 192.168.122.168 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] no_snapshot_gb_quota           = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] num_iser_scan_tries            = 3 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] num_shell_tries                = 3 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] num_volume_device_scan_tries   = 3 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] nvmeof_conn_info_version       = 1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] nvmet_ns_id                    = 10 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] nvmet_port_id                  = 1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] osapi_max_limit                = 1000 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] osapi_volume_ext_list          = [] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] osapi_volume_listen_port       = 8776 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] osapi_volume_use_ssl           = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] osapi_volume_workers           = 2 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] per_volume_size_limit          = -1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] periodic_fuzzy_delay           = 60 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] periodic_interval              = 60 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] public_endpoint                = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] publish_errors                 = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] quota_backup_gigabytes         = 1000 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] quota_backups                  = 10 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] quota_gigabytes                = 1000 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] quota_groups                   = 10 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] quota_snapshots                = 10 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] quota_volumes                  = 10 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] rate_limit_burst               = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] rate_limit_except_level        = CRITICAL {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] rate_limit_interval            = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] reinit_driver_count            = 3 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] replication_device             = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] report_discard_supported       = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] report_interval                = 120 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] reservation_clean_interval     = 86400 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] reservation_expire             = 86400 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] reserved_image_namespaces      = [] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] reserved_percentage            = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] rpc_response_timeout           = 120 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] run_external_periodic_tasks    = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] scst_target_driver             = iscsi {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] scst_target_iqn_name           = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] service_down_time              = 720 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] shell_completion               = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] snapshot_name_template         = snapshot-%s {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] snapshot_same_host             = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] split_loggers                  = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] state_path                     = /opt/stack/data/cinder {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] storage_availability_zone      = nova {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] storage_protocol               = iSCSI {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] syslog_log_facility            = LOG_USER {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] target_helper                  = lioadm {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] target_ip_address              = 192.168.122.168 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] target_port                    = 3260 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] target_protocol                = iscsi {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] target_secondary_ip_addresses  = [] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] trace_flags                    = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] transport_url                  = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] until_refresh                  = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] use_chap_auth                  = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] use_default_quota_class        = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] use_journal                    = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] use_json                       = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] use_multipath_for_image_xfer   = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] use_stderr                     = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] use_syslog                     = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] verify_glance_signatures       = enabled {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] volume_api_class               = cinder.volume.api.API {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] volume_backend_name            = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] volume_clear                   = zero {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] volume_clear_ionice            = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] volume_clear_size              = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] volume_copy_bps_limit          = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] volume_dd_blocksize            = 1M {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] volume_name_template           = volume-%s {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] volume_service_inithost_offload = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] volume_usage_audit_period      = month {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] watch_log_file                 = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] zoning_mode                    = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:07:56 devstack cinder-volume[75129]: INFO cinder.volume.manager [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_concurrency.disable_process_locking = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.admin_password = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.admin_token = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.admin_user  = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.auth_port   = 35357 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.auth_protocol = https {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.auth_section = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.auth_type   = password {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.auth_uri    = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.auth_version = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.cache       = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.certfile    = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.delay_auth_decision = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.http_connect_timeout = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.identity_uri = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.include_service_catalog = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.insecure    = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.interface   = public {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.keyfile     = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_password =  {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:56 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcache_username =  {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.region_name = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.service_token_roles_required = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.service_type = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.token_cache_time = 300 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.backend                  = dogpile.cache.null {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.backend_argument         = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.backend_expiration_time  = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.config_prefix            = cache.oslo {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.dead_timeout             = 60.0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.debug_cache_backend      = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.enable_retry_client      = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.enable_socket_keepalive  = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.enabled                  = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.enforce_fips_mode        = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.expiration_time          = 600 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.hashclient_retry_attempts = 2 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.memcache_dead_retry      = 300 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.memcache_password        = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.memcache_pool_maxsize    = 10 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.memcache_sasl_enabled    = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.memcache_username        = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.proxies                  = [] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.redis_db                 = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.redis_password           = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.redis_sentinel_service_name = mymaster {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.redis_server             = localhost:6379 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.redis_socket_timeout     = 1.0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.redis_username           = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.retry_attempts           = 2 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.retry_delay              = 0.0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.socket_keepalive_count   = 1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.socket_keepalive_idle    = 1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.socket_keepalive_interval = 1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.tls_allowed_ciphers      = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.tls_cafile               = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.tls_certfile             = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.tls_enabled              = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cache.tls_keyfile              = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] coordination.backend_url       = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.asyncio_connection    = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.asyncio_slave_connection = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.backend               = sqlalchemy {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.connection            = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.connection_debug      = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.connection_parameters =  {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.connection_recycle_time = 3600 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.connection_trace      = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.db_inc_retry_interval = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.db_max_retries        = 20 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.db_max_retry_interval = 10 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.db_retry_interval     = 1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.max_overflow          = 50 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.max_pool_size         = 5 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.max_retries           = 10 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.mysql_wsrep_sync_wait = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.pool_timeout          = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.retry_interval        = 10 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.slave_connection      = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.sqlite_synchronous    = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] database.use_db_reconnect      = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] profiler.connection_string     = messaging:// {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] profiler.enabled               = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] profiler.es_doc_type           = notification {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] profiler.es_scroll_size        = 10000 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] profiler.es_scroll_time        = 2m {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] profiler.filter_error_trace    = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] profiler.hmac_keys             = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] profiler.sentinel_service_name = mymaster {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] profiler.socket_timeout        = 0.1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] profiler.trace_requests        = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] profiler.trace_sqlalchemy      = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] profiler_jaeger.process_tags   = {} {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] profiler_jaeger.service_name_prefix = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] profiler_otlp.service_name_prefix = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_policy.enforce_new_defaults = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.226s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:07:57 devstack cinder-volume[75029]: WARNING oslo_config.cfg [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_policy.enforce_scope      = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_policy.policy_default_rule = default {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_policy.policy_file        = policy.yaml {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] privsep_osbrick.group          = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] privsep_osbrick.helper_command = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] privsep_osbrick.user           = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cinder_sys_admin.group         = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cinder_sys_admin.helper_command = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] cinder_sys_admin.user          = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] service_user.auth_section      = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] service_user.auth_type         = password {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] service_user.certfile          = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] service_user.collect_timing    = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] service_user.insecure          = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] service_user.keyfile           = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] service_user.send_service_user_token = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] service_user.split_loggers     = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] service_user.timeout           = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.backend_availability_zone = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.chap_password = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.chap_username =  {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.driver_client_cert = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.driver_client_cert_key = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.driver_data_namespace = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.driver_use_ssl = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.enable_unsupported_driver = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.extra_capabilities = {} {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.filter_function = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.goodness_function = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.iscsi_iotype  = fileio {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.iscsi_target_flags =  {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.iscsi_write_cache = on {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.iser_helper   = tgtadm {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.iser_ip_address = 192.168.122.168 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.iser_port     = 3260 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.lvm_share_target = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.lvm_type      = auto {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.num_shell_tries = 3 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.nvmet_port_id = 1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.replication_device = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.report_discard_supported = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.reserved_percentage = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.scst_target_driver = iscsi {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.scst_target_iqn_name = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.storage_protocol = iSCSI {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.target_helper = tgtadm {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.target_ip_address = 192.168.122.168 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.target_port   = 3260 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.target_protocol = iscsi {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.trace_flags   = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.unique_fqdn_network = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.use_chap_auth = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.volume_backend_name = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.volume_clear  = zero {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.volume_clear_ionice = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.volume_clear_size = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_reports.file_event_handler = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_reports.log_dir           = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.backend_availability_zone = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.backend_host       = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.chap_password      = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.chap_username      = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.driver_client_cert = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.driver_data_namespace = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.extra_capabilities = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.filter_function    = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.goodness_function  = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.iscsi_iotype       = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.iser_helper        = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.iser_ip_address    = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.iser_port          = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.iser_target_prefix = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.lvm_share_target   = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.lvm_type           = auto {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.num_shell_tries    = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.replication_device = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.report_discard_supported = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.reserved_percentage = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.scst_target_driver = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.storage_protocol   = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.target_helper      = lioadm {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.target_ip_address  = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.target_port        = 3260 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.trace_flags        = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.use_chap_auth      = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.volume_clear       = zero {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.volume_clear_size  = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] lvmdriver-1.volumes_dir        = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.146s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.ssl      = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_notifications.driver = [] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_notifications.retry = -1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] oslo_messaging_notifications.transport_url = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] key_manager.fixed_key          = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.barbican_api_version  = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.barbican_endpoint     = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.barbican_endpoint_type = public {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.barbican_region_name  = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.cafile                = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.certfile              = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.collect_timing        = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.insecure              = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.keyfile               = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.number_of_retries     = 60 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.retry_delay           = 1 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.send_service_user_token = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.split_loggers         = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.timeout               = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.verify_ssl            = True {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican.verify_ssl_path       = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican_service_user.auth_section = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican_service_user.auth_type = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican_service_user.cafile   = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican_service_user.certfile = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican_service_user.collect_timing = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican_service_user.insecure = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican_service_user.keyfile  = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican_service_user.split_loggers = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] barbican_service_user.timeout  = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] vault.approle_role_id          = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] vault.approle_secret_id        = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] vault.kv_mountpoint            = secret {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] vault.kv_path                  = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] vault.kv_version               = 2 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] vault.namespace                = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] vault.root_token_id            = **** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] vault.ssl_ca_crt_file          = None {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] vault.timeout                  = 60.0 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] vault.use_ssl                  = False {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:07:57 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] ******************************************************************************** {{(pid=75029) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 10 19:07:57 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.167s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:07:57 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:07:57 devstack sudo[75182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 10 19:07:57 devstack sudo[75182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:07:59 devstack sudo[75182]: pam_unix(sudo:session): session closed for user root
Sep 10 19:07:59 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.317s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:07:59 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:00 devstack sudo[75332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:08:00 devstack sudo[75332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:02 devstack sudo[75332]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:02 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 2.143s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:02 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:08:02 devstack cinder-volume[75129]: INFO cinder.brick.local_dev.lvm [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 10 19:08:02 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:02 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.085s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:02 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:02 devstack sudo[75429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 19:08:02 devstack sudo[75429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:04 devstack sudo[75429]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:04 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.082s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:04 devstack cinder-volume[75129]: DEBUG cinder.brick.local_dev.lvm [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75129) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 10 19:08:04 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:04 devstack sudo[75522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:08:04 devstack sudo[75522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:06 devstack cinder-volume[75029]: DEBUG dbcounter [-] [75029] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75029) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:08:08 devstack sudo[75522]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:08 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 4.110s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:08 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:08 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.090s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:08 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:08 devstack sudo[75747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:08:08 devstack sudo[75747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:11 devstack sudo[75747]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:11 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.463s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:11 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:11 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.087s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:11 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:11 devstack sudo[75788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 10 19:08:11 devstack sudo[75788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:13 devstack sudo[75788]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:13 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.228s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:13 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:13 devstack sudo[75830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 19:08:13 devstack sudo[75830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:16 devstack sudo[75830]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:16 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.219s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:16 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:16 devstack sudo[75913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 19:08:16 devstack sudo[75913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:20 devstack sudo[75913]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:20 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.724s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:20 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:20 devstack sudo[75919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:08:20 devstack sudo[75919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:24 devstack sudo[75919]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:24 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 3.596s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:24 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:24 devstack sudo[75923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:08:24 devstack sudo[75923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:26 devstack sudo[75923]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:26 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.404s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:26 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:26 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.120s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:26 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:26 devstack sudo[75929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:08:26 devstack sudo[75929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:29 devstack sudo[75929]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:29 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.418s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:29 devstack cinder-volume[75129]: INFO cinder.volume.drivers.lvm [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 10 19:08:29 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:29 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.095s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:29 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:29 devstack sudo[76006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:08:29 devstack sudo[76006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:31 devstack sudo[76006]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:31 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.072s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:31 devstack cinder-volume[75129]: DEBUG cinder.volume.drivers.lvm [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Updating volume stats {{(pid=75129) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 19:08:31 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:31 devstack sudo[76076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 19:08:31 devstack sudo[76076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:33 devstack sudo[76076]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:33 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.115s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:33 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:33 devstack sudo[76192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:08:33 devstack sudo[76192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:35 devstack sudo[76192]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:35 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.164s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:35 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:35 devstack sudo[76195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:08:35 devstack sudo[76195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:37 devstack sudo[76195]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:37 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.065s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:37 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:37 devstack sudo[76200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:08:37 devstack sudo[76200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:39 devstack sudo[76200]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:39 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.049s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:39 devstack cinder-volume[75129]: INFO cinder.volume.driver [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Driver hasn't implemented _init_vendor_properties()
Sep 10 19:08:39 devstack cinder-volume[75129]: DEBUG cinder.volume.driver [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75129) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 10 19:08:40 devstack cinder-volume[75129]: DEBUG oslo_db.sqlalchemy.engines [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75129) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 19:08:40 devstack cinder-volume[75129]: DEBUG dbcounter [-] [75129] Writer thread running {{(pid=75129) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 19:08:40 devstack cinder-volume[75129]: DEBUG cinder.db.sqlalchemy.api [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Building query based on filter {{(pid=75129) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 10 19:08:40 devstack cinder-volume[75129]: DEBUG cinder.image.image_utils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75129) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 10 19:08:40 devstack cinder-volume[75129]: INFO cinder.keymgr.migration [None req-c91f44cd-ae43-425a-b7ed-52d9866021b1 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 10 19:08:40 devstack cinder-volume[75129]: DEBUG cinder.volume.drivers.lvm [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Updating volume stats {{(pid=75129) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 19:08:40 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:40 devstack sudo[76205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 19:08:40 devstack sudo[76205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:42 devstack sudo[76205]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:42 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.472s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:42 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:43 devstack sudo[76238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:08:43 devstack sudo[76238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:45 devstack sudo[76238]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:45 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.163s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:45 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:45 devstack sudo[76347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:08:45 devstack sudo[76347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:47 devstack sudo[76347]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:47 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.108s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:47 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:47 devstack sudo[76357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:08:47 devstack sudo[76357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:49 devstack sudo[76357]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:49 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.006s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:49 devstack cinder-volume[75129]: DEBUG cinder.manager [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Notifying Schedulers of capabilities ... {{(pid=75129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:08:49 devstack cinder-volume[75129]: INFO cinder.volume.manager [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Driver initialization completed successfully.
Sep 10 19:08:49 devstack cinder-volume[75129]: INFO cinder.manager [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Initiating service 2 cleanup
Sep 10 19:08:49 devstack cinder-volume[75129]: INFO cinder.manager [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Service 2 cleanup completed.
Sep 10 19:08:49 devstack cinder-volume[75129]: DEBUG cinder.service [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Creating RPC server for service cinder-volume {{(pid=75129) start /opt/stack/cinder/cinder/service.py:239}}
Sep 10 19:08:49 devstack cinder-volume[75129]: DEBUG cinder.service [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75129) start /opt/stack/cinder/cinder/service.py:245}}
Sep 10 19:08:49 devstack cinder-volume[75129]: INFO cinder.volume.manager [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 10 19:08:49 devstack cinder-volume[75129]: DEBUG cinder.volume.drivers.lvm [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Updating volume stats {{(pid=75129) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 19:08:49 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:49 devstack sudo[76362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 19:08:49 devstack sudo[76362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:50 devstack cinder-volume[75129]: DEBUG dbcounter [-] [75129] Writing DB stats cinder:SELECT=1 {{(pid=75129) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:08:51 devstack sudo[76362]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:51 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.960s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:51 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:51 devstack sudo[76371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:08:51 devstack sudo[76371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:53 devstack sudo[76371]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:53 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.121s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:53 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:54 devstack sudo[76375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:08:54 devstack sudo[76375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:55 devstack sudo[76375]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:55 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.980s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:56 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:56 devstack sudo[76382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:08:56 devstack sudo[76382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:08:58 devstack sudo[76382]: pam_unix(sudo:session): session closed for user root
Sep 10 19:08:58 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.100s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:58 devstack cinder-volume[75129]: DEBUG dbcounter [-] [75129] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75129) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:08:58 devstack cinder-volume[75129]: INFO cinder.volume.manager [None req-0b3cfeb5-bf49-499c-933a-83d57bccbed7 None None] Driver post RPC initialization completed successfully.
Sep 10 19:09:00 devstack cinder-volume[75129]: DEBUG oslo_service.periodic_task [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75129) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:09:00 devstack cinder-volume[75129]: DEBUG cinder.volume.drivers.lvm [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Updating volume stats {{(pid=75129) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 19:09:00 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:00 devstack sudo[76385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 19:09:00 devstack sudo[76385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:09:02 devstack sudo[76385]: pam_unix(sudo:session): session closed for user root
Sep 10 19:09:02 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.860s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:02 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:02 devstack sudo[76391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:09:02 devstack sudo[76391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:09:04 devstack sudo[76391]: pam_unix(sudo:session): session closed for user root
Sep 10 19:09:04 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.810s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:04 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:04 devstack sudo[76394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:09:04 devstack sudo[76394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:09:06 devstack sudo[76394]: pam_unix(sudo:session): session closed for user root
Sep 10 19:09:06 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.990s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:06 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:06 devstack sudo[76406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:09:06 devstack sudo[76406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:09:08 devstack cinder-volume[75129]: DEBUG dbcounter [-] [75129] Writing DB stats cinder:UPDATE=1 {{(pid=75129) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:09:08 devstack sudo[76406]: pam_unix(sudo:session): session closed for user root
Sep 10 19:09:08 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.289s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:08 devstack cinder-volume[75129]: DEBUG cinder.manager [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Notifying Schedulers of capabilities ... {{(pid=75129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:10:00 devstack cinder-volume[75129]: DEBUG oslo_service.periodic_task [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75129) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:10:00 devstack cinder-volume[75129]: DEBUG cinder.volume.drivers.lvm [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Updating volume stats {{(pid=75129) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 19:10:00 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:00 devstack sudo[77735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 19:10:00 devstack sudo[77735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:10:02 devstack sudo[77735]: pam_unix(sudo:session): session closed for user root
Sep 10 19:10:02 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.095s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:02 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:02 devstack sudo[77742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:10:02 devstack sudo[77742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:10:04 devstack sudo[77742]: pam_unix(sudo:session): session closed for user root
Sep 10 19:10:04 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.956s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:04 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:04 devstack sudo[77746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:10:04 devstack sudo[77746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:10:06 devstack sudo[77746]: pam_unix(sudo:session): session closed for user root
Sep 10 19:10:06 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.896s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:06 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:06 devstack sudo[77758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:10:06 devstack sudo[77758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:10:08 devstack sudo[77758]: pam_unix(sudo:session): session closed for user root
Sep 10 19:10:08 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.064s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:08 devstack cinder-volume[75129]: DEBUG cinder.manager [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Notifying Schedulers of capabilities ... {{(pid=75129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:11:00 devstack cinder-volume[75129]: DEBUG oslo_service.periodic_task [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75129) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:11:00 devstack cinder-volume[75129]: DEBUG cinder.volume.drivers.lvm [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Updating volume stats {{(pid=75129) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 19:11:00 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:11:00 devstack sudo[78186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 19:11:00 devstack sudo[78186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:11:02 devstack sudo[78186]: pam_unix(sudo:session): session closed for user root
Sep 10 19:11:02 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.030s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:11:02 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:11:02 devstack sudo[78190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:11:02 devstack sudo[78190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:11:04 devstack sudo[78190]: pam_unix(sudo:session): session closed for user root
Sep 10 19:11:04 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.092s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:11:04 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:11:04 devstack sudo[78211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:11:04 devstack sudo[78211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:11:06 devstack sudo[78211]: pam_unix(sudo:session): session closed for user root
Sep 10 19:11:06 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.164s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:11:06 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:11:06 devstack sudo[78214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:11:06 devstack sudo[78214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:11:08 devstack cinder-volume[75129]: DEBUG dbcounter [-] [75129] Writing DB stats cinder:SELECT=1 {{(pid=75129) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:11:08 devstack cinder-volume[75129]: DEBUG dbcounter [-] [75129] Writing DB stats cinder:UPDATE=1 {{(pid=75129) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:11:09 devstack sudo[78214]: pam_unix(sudo:session): session closed for user root
Sep 10 19:11:09 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.257s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:11:09 devstack cinder-volume[75129]: DEBUG cinder.manager [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Notifying Schedulers of capabilities ... {{(pid=75129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:12:00 devstack cinder-volume[75129]: DEBUG oslo_service.periodic_task [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75129) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:12:00 devstack cinder-volume[75129]: DEBUG cinder.volume.drivers.lvm [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Updating volume stats {{(pid=75129) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 19:12:00 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:12:00 devstack sudo[80510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 19:12:00 devstack sudo[80510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:12:02 devstack sudo[80510]: pam_unix(sudo:session): session closed for user root
Sep 10 19:12:02 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.177s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:12:02 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:12:02 devstack sudo[80659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:12:02 devstack sudo[80659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:12:04 devstack sudo[80659]: pam_unix(sudo:session): session closed for user root
Sep 10 19:12:04 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.020s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:12:04 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:12:04 devstack sudo[80785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:12:04 devstack sudo[80785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:12:06 devstack sudo[80785]: pam_unix(sudo:session): session closed for user root
Sep 10 19:12:06 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.112s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:12:06 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:12:06 devstack sudo[80934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:12:06 devstack sudo[80934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:12:08 devstack sudo[80934]: pam_unix(sudo:session): session closed for user root
Sep 10 19:12:08 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.060s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:12:08 devstack cinder-volume[75129]: DEBUG cinder.manager [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Notifying Schedulers of capabilities ... {{(pid=75129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:13:00 devstack cinder-volume[75129]: DEBUG oslo_service.periodic_task [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75129) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:13:00 devstack cinder-volume[75129]: DEBUG cinder.volume.drivers.lvm [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Updating volume stats {{(pid=75129) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 19:13:00 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:13:00 devstack sudo[81448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 19:13:00 devstack sudo[81448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:13:02 devstack sudo[81448]: pam_unix(sudo:session): session closed for user root
Sep 10 19:13:02 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.119s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:13:02 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:13:02 devstack sudo[81454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:13:02 devstack sudo[81454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:13:04 devstack sudo[81454]: pam_unix(sudo:session): session closed for user root
Sep 10 19:13:04 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.060s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:13:04 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:13:04 devstack sudo[81460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:13:04 devstack sudo[81460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:13:06 devstack sudo[81460]: pam_unix(sudo:session): session closed for user root
Sep 10 19:13:06 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.203s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:13:06 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:13:06 devstack sudo[81465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:13:06 devstack sudo[81465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:13:08 devstack cinder-volume[75129]: DEBUG dbcounter [-] [75129] Writing DB stats cinder:SELECT=1 {{(pid=75129) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:13:08 devstack cinder-volume[75129]: DEBUG dbcounter [-] [75129] Writing DB stats cinder:UPDATE=1 {{(pid=75129) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:13:08 devstack sudo[81465]: pam_unix(sudo:session): session closed for user root
Sep 10 19:13:08 devstack cinder-volume[75129]: DEBUG oslo_concurrency.processutils [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.908s {{(pid=75129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:13:08 devstack cinder-volume[75129]: DEBUG cinder.manager [None req-28c37313-38d8-4b02-930a-b58a6058f712 None None] Notifying Schedulers of capabilities ... {{(pid=75129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:14:53 devstack cinder-volume[75029]: INFO oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Caught SIGTERM, stopping children
Sep 10 19:14:53 devstack cinder-volume[75029]: DEBUG oslo_concurrency.lockutils [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Acquiring lock "singleton_lock" {{(pid=75029) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 19:14:53 devstack cinder-volume[75029]: DEBUG oslo_concurrency.lockutils [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Acquired lock "singleton_lock" {{(pid=75029) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 19:14:53 devstack cinder-volume[75029]: DEBUG oslo_concurrency.lockutils [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Releasing lock "singleton_lock" {{(pid=75029) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 19:14:53 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Stop services. {{(pid=75029) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 10 19:14:53 devstack cinder-volume[75029]: DEBUG oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Killing children. {{(pid=75029) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 10 19:14:53 devstack cinder-volume[75029]: INFO oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Waiting on 1 children to exit
Sep 10 19:14:54 devstack cinder-volume[75129]: DEBUG oslo_concurrency.lockutils [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Acquiring lock "singleton_lock" {{(pid=75129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 19:14:54 devstack cinder-volume[75129]: DEBUG oslo_concurrency.lockutils [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Acquired lock "singleton_lock" {{(pid=75129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 19:14:54 devstack cinder-volume[75129]: DEBUG oslo_concurrency.lockutils [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Releasing lock "singleton_lock" {{(pid=75129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 19:14:54 devstack cinder-volume[75129]: WARNING amqp [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 10 19:14:54 devstack cinder-volume[75129]: WARNING amqp [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 10 19:14:54 devstack cinder-volume[75029]: INFO oslo_service.backend._eventlet.service [None req-39d74a09-214c-4ac2-a048-956910693c7f None None] Child 75129 exited with status 0
Sep 10 19:15:12 devstack cinder-volume[82606]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 19:15:12 devstack cinder-volume[82606]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 19:15:12 devstack cinder-volume[82606]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82606) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 19:15:16 devstack cinder-volume[82606]: INFO dbcounter [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] Registered counter for database cinder
Sep 10 19:15:17 devstack cinder-volume[82606]: DEBUG oslo_db.sqlalchemy.engines [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82606) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 19:15:17 devstack cinder-volume[82606]: DEBUG dbcounter [-] [82606] Writer thread running {{(pid=82606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 19:15:17 devstack cinder-volume[82606]: INFO cinder.rpc [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 10 19:15:17 devstack cinder-volume[82606]: INFO cinder.rpc [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 10 19:15:17 devstack cinder-volume[82606]: DEBUG oslo_db.sqlalchemy.engines [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82606) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 19:15:18 devstack cinder-volume[82606]: INFO cinder.volume.manager [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] Determined volume DB was empty at startup.
Sep 10 19:15:18 devstack cinder-volume[82606]: DEBUG cinder.volume.manager [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82606) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 10 19:15:18 devstack cinder-volume[82606]: INFO cinder.volume.manager [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 10 19:15:18 devstack cinder-volume[82606]: WARNING stevedore.named [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 10 19:15:18 devstack cinder-volume[82606]: WARNING castellan.key_manager [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 19:15:18 devstack cinder-volume[82606]: WARNING cinder.keymgr.conf_key_mgr [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 19:15:18 devstack cinder-volume[82606]: INFO cinder.volume.manager [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 10 19:15:18 devstack cinder-volume[82606]: DEBUG oslo_db.sqlalchemy.engines [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82606) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 19:15:18 devstack cinder-volume[82606]: INFO oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] Starting 1 workers
Sep 10 19:15:18 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] Started child 82850 {{(pid=82606) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 10 19:15:18 devstack cinder-volume[82850]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 10 19:15:18 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] Full set of CONF: {{(pid=82606) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 10 19:15:18 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] ******************************************************************************** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 10 19:15:18 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] Configuration options gathered from: {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 10 19:15:18 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] ================================================================================ {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] allow_availability_zone_fallback = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] allow_compression_on_image_upload = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] allowed_direct_url_schemes     = [] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] api_rate_limit                 = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] auth_strategy                  = keystone {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_availability_zone      = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_host                   = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_name                   = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_stats_polling_interval = 60 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backup_api_class               = cinder.backup.api.API {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backup_name_template           = backup-%s {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backup_use_same_host           = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backup_use_temp_snapshot       = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] chap_password                  = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] chap_username                  =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cinder_internal_tenant_project_id = bd32b904acd64a5b9d65d4a0f3010663 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cinder_internal_tenant_user_id = 50fbc69f060840c787a61d1fbef59962 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cluster                        = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] compression_format             = gzip {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] compute_api_class              = cinder.compute.nova.API {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] config_dir                     = [] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] config_source                  = [] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] control_exchange               = openstack {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] debug                          = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] default_availability_zone      = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] default_group_type             = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] default_volume_type            = QuobyteHD {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] driver_client_cert             = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] driver_client_cert_key         = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] driver_data_namespace          = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] driver_ssl_cert_path           = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] driver_ssl_cert_verify         = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] driver_use_ssl                 = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] enable_new_services            = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] enable_unsupported_driver      = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] enabled_backends               = ['QuobyteHD'] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] enforce_multipath_for_image_xfer = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] filter_function                = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] glance_api_insecure            = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] glance_api_servers             = ['http://192.168.122.168/image'] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] glance_api_ssl_compression     = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] glance_ca_certificates_file    = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] glance_catalog_info            = image:glance:publicURL {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] glance_certfile                = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] glance_keyfile                 = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] glance_num_retries             = 3 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] glance_request_timeout         = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] goodness_function              = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] graceful_shutdown_timeout      = 5 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] group_api_class                = cinder.group.api.API {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] host                           = devstack {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] image_compress_on_upload       = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] image_conversion_address_space_limit = 1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] image_conversion_cpu_limit     = 60 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] image_conversion_disable       = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] image_upload_use_cinder_backend = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] image_upload_use_internal_tenant = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] image_volume_cache_enabled     = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] image_volume_cache_max_count   = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] image_volume_cache_max_size_gb = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] init_host_max_objects_retrieval = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] instance_format                = [instance: %(uuid)s]  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] iscsi_iotype                   = fileio {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] iscsi_target_flags             =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] iscsi_write_cache              = on {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] iser_helper                    = tgtadm {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] iser_ip_address                = 192.168.122.168 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] iser_port                      = 3260 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] log_color                      = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] log_config_append              = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] log_dir                        = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] log_file                       = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] log_options                    = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] log_rotate_interval            = 1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] log_rotate_interval_type       = days {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] log_rotation_type              = none {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] max_age                        = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] max_logfile_count              = 30 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] max_logfile_size_mb            = 200 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] max_over_subscription_ratio    = 20.0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] message_reap_interval          = 86400 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] message_ttl                    = 2592000 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] migration_create_volume_timeout_secs = 300 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] monkey_patch                   = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] monkey_patch_modules           = [] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] my_ip                          = 192.168.122.168 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] no_snapshot_gb_quota           = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] num_iser_scan_tries            = 3 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] num_shell_tries                = 3 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] num_volume_device_scan_tries   = 3 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] nvmeof_conn_info_version       = 1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] nvmet_ns_id                    = 10 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] nvmet_port_id                  = 1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] osapi_max_limit                = 1000 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] osapi_volume_ext_list          = [] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] osapi_volume_listen_port       = 8776 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] osapi_volume_use_ssl           = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] osapi_volume_workers           = 2 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] per_volume_size_limit          = -1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] periodic_fuzzy_delay           = 60 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] periodic_interval              = 60 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] public_endpoint                = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] publish_errors                 = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] quota_backup_gigabytes         = 1000 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] quota_backups                  = 10 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] quota_gigabytes                = 1000 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] quota_groups                   = 10 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:19 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 10 19:15:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=82850) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] quota_snapshots                = 10 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] quota_volumes                  = 10 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] rate_limit_burst               = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] rate_limit_except_level        = CRITICAL {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] rate_limit_interval            = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] reinit_driver_count            = 3 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] replication_device             = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] report_discard_supported       = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] report_interval                = 120 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] reservation_clean_interval     = 86400 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] reservation_expire             = 86400 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] reserved_image_namespaces      = [] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] reserved_percentage            = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] rpc_response_timeout           = 120 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] run_external_periodic_tasks    = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] scst_target_driver             = iscsi {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] scst_target_iqn_name           = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] service_down_time              = 720 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] shell_completion               = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] snapshot_name_template         = snapshot-%s {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] split_loggers                  = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] state_path                     = /opt/stack/data/cinder {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] storage_availability_zone      = nova {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] storage_protocol               = iSCSI {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] syslog_log_facility            = LOG_USER {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] target_helper                  = lioadm {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] target_ip_address              = 192.168.122.168 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] target_port                    = 3260 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] target_protocol                = iscsi {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] target_secondary_ip_addresses  = [] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] trace_flags                    = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] transport_url                  = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] until_refresh                  = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] use_chap_auth                  = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] use_default_quota_class        = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] use_journal                    = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] use_json                       = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] use_multipath_for_image_xfer   = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] use_stderr                     = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] use_syslog                     = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] verify_glance_signatures       = enabled {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] volume_api_class               = cinder.volume.api.API {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] volume_backend_name            = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] volume_clear                   = zero {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] volume_clear_ionice            = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] volume_clear_size              = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] volume_copy_bps_limit          = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] volume_dd_blocksize            = 1M {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] volume_name_template           = volume-%s {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] volume_service_inithost_offload = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] volume_usage_audit_period      = month {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] watch_log_file                 = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] zoning_mode                    = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_concurrency.disable_process_locking = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.admin_password = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.admin_token = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.admin_user  = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.auth_port   = 35357 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.auth_protocol = https {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.auth_section = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.auth_type   = password {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.auth_uri    = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.auth_version = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.cache       = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.certfile    = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.delay_auth_decision = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.http_connect_timeout = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.identity_uri = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.include_service_catalog = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.insecure    = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.interface   = public {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.keyfile     = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_password =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcache_username =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.region_name = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.service_token_roles_required = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.service_type = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.token_cache_time = 300 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.backend                  = dogpile.cache.null {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.backend_argument         = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.backend_expiration_time  = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.config_prefix            = cache.oslo {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.dead_timeout             = 60.0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.debug_cache_backend      = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.enable_retry_client      = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.enable_socket_keepalive  = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.enabled                  = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.enforce_fips_mode        = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.expiration_time          = 600 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.hashclient_retry_attempts = 2 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.memcache_dead_retry      = 300 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.memcache_password        = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.memcache_pool_maxsize    = 10 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.memcache_sasl_enabled    = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.memcache_username        = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.proxies                  = [] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.redis_db                 = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.redis_password           = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.redis_sentinel_service_name = mymaster {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.redis_server             = localhost:6379 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.redis_socket_timeout     = 1.0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.redis_username           = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.retry_attempts           = 2 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.retry_delay              = 0.0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.socket_keepalive_count   = 1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.socket_keepalive_idle    = 1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.socket_keepalive_interval = 1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.tls_allowed_ciphers      = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.tls_cafile               = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.tls_certfile             = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.tls_enabled              = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cache.tls_keyfile              = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] coordination.backend_url       = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.asyncio_connection    = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.asyncio_slave_connection = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.backend               = sqlalchemy {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.connection            = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.connection_debug      = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.connection_parameters =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.connection_recycle_time = 3600 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.connection_trace      = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.db_inc_retry_interval = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.db_max_retries        = 20 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.db_max_retry_interval = 10 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.db_retry_interval     = 1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.max_overflow          = 50 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.max_pool_size         = 5 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.max_retries           = 10 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.mysql_wsrep_sync_wait = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.pool_timeout          = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.retry_interval        = 10 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.slave_connection      = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.sqlite_synchronous    = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] database.use_db_reconnect      = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] profiler.connection_string     = messaging:// {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] profiler.enabled               = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] profiler.es_doc_type           = notification {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] profiler.es_scroll_size        = 10000 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] profiler.es_scroll_time        = 2m {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] profiler.filter_error_trace    = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] profiler.hmac_keys             = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] profiler.sentinel_service_name = mymaster {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] profiler.socket_timeout        = 0.1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] profiler.trace_requests        = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] profiler.trace_sqlalchemy      = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] profiler_jaeger.process_tags   = {} {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] profiler_jaeger.service_name_prefix = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] profiler_otlp.service_name_prefix = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_policy.enforce_new_defaults = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: WARNING oslo_config.cfg [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_policy.enforce_scope      = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_policy.policy_default_rule = default {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_policy.policy_file        = policy.yaml {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] privsep_osbrick.group          = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] privsep_osbrick.helper_command = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] privsep_osbrick.user           = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cinder_sys_admin.group         = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cinder_sys_admin.helper_command = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] cinder_sys_admin.user          = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] service_user.auth_section      = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] service_user.auth_type         = password {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] service_user.certfile          = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] service_user.collect_timing    = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] service_user.insecure          = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] service_user.keyfile           = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] service_user.send_service_user_token = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] service_user.split_loggers     = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] service_user.timeout           = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.backend_availability_zone = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.chap_password = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.chap_username =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.driver_client_cert = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.driver_client_cert_key = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.driver_data_namespace = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.driver_use_ssl = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.enable_unsupported_driver = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.extra_capabilities = {} {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.filter_function = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.goodness_function = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.iscsi_iotype  = fileio {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.iscsi_target_flags =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.iscsi_write_cache = on {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.iser_helper   = tgtadm {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.iser_ip_address = 192.168.122.168 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.iser_port     = 3260 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.nas_host      =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.nas_login     = admin {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.nas_mount_options = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.nas_password  = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.nas_private_key =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.nas_share_path =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.num_shell_tries = 3 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.nvmet_port_id = 1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.quobyte_client_cfg = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.quobyte_volume_url = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.replication_device = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.report_discard_supported = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.reserved_percentage = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.scst_target_driver = iscsi {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.scst_target_iqn_name = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.storage_protocol = iSCSI {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.target_helper = tgtadm {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.target_ip_address = 192.168.122.168 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.target_port   = 3260 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.target_protocol = iscsi {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.trace_flags   = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.unique_fqdn_network = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.use_chap_auth = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.volume_backend_name = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.volume_clear  = zero {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.volume_clear_ionice = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.volume_clear_size = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_reports.file_event_handler = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_reports.log_dir           = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.backend_availability_zone = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.backend_host         = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.chap_password        = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.chap_username        = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.chiscsi_conf         = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.driver_client_cert   = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.driver_client_cert_key = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.driver_data_namespace = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.driver_use_ssl       = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.extra_capabilities   = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.filter_function      = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.goodness_function    = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.iscsi_iotype         = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.iser_helper          = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.iser_ip_address      = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.iser_port            = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.iser_target_prefix   = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.nas_host             = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.nas_login            = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.nas_mount_options    = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.nas_password         = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.nas_private_key      = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.nas_share_path       = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.nas_ssh_port         = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.num_shell_tries      = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=82850) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 10 19:15:19 devstack cinder-volume[82850]: INFO cinder.volume.drivers.quobyte [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.nvmet_port_id        = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Running cmd (subprocess): mount.quobyte {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.replication_device   = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.report_discard_supported = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.reserved_percentage  = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.scst_target_driver   = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.storage_protocol     = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.target_helper        = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.target_ip_address    = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.target_port          = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.target_prefix        = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.target_protocol      = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.trace_flags          = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.use_chap_auth        = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.volume_clear         = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.volume_clear_size    = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] QuobyteHD.volumes_dir          = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.ssl      = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_notifications.driver = [] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:19 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_notifications.retry = -1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] oslo_messaging_notifications.transport_url = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] key_manager.fixed_key          = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.barbican_api_version  = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.barbican_endpoint     = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.barbican_endpoint_type = public {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.barbican_region_name  = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.cafile                = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.certfile              = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.collect_timing        = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.insecure              = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.keyfile               = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.number_of_retries     = 60 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.retry_delay           = 1 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.send_service_user_token = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.split_loggers         = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.timeout               = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.verify_ssl            = True {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican.verify_ssl_path       = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican_service_user.auth_section = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican_service_user.auth_type = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican_service_user.cafile   = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican_service_user.certfile = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican_service_user.collect_timing = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican_service_user.insecure = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican_service_user.keyfile  = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican_service_user.split_loggers = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] barbican_service_user.timeout  = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] vault.approle_role_id          = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] vault.approle_secret_id        = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] vault.kv_mountpoint            = secret {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] vault.kv_path                  = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] vault.kv_version               = 2 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] vault.namespace                = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] vault.root_token_id            = **** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] vault.ssl_ca_crt_file          = None {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] vault.timeout                  = 60.0 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] vault.use_ssl                  = False {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:15:20 devstack cinder-volume[82606]: DEBUG oslo_service.backend._eventlet.service [None req-b61c34f8-2a00-4b71-8526-09c542c58edf None None] ******************************************************************************** {{(pid=82606) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 10 19:15:20 devstack quobyte-client[82853]: Reading configuration file: /etc/quobyte/client.cfg
Sep 10 19:15:20 devstack quobyte-client[82853]: Invalid parameters found, error: missing mount point.
Sep 10 19:15:20 devstack quobyte-client[82853]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 10 19:15:20 devstack quobyte-client[82853]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 10 19:15:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] CMD "mount.quobyte" returned: 1 in 0.854s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:20 devstack cinder-volume[82850]: INFO cinder.volume.drivers.quobyte [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Mounting volume: 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a ...
Sep 10 19:15:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba -c /etc/quobyte/client-cinder.cfg {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:21 devstack quobyte-client[82854]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 10 19:15:21 devstack quobyte-client[82854]: Reading configuration file: /etc/quobyte/client.cfg
Sep 10 19:15:21 devstack quobyte-client[82854]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba' to display the log.
Sep 10 19:15:21 devstack quobyte-client[82855]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 10 19:15:21 devstack quobyte-client[82855]: mount.quobyte 3.25 (4fbbd59204)
Sep 10 19:15:21 devstack quobyte-client[82855]: Client UUID: ojGNwcV3-uBGm-7bw7-ekxB-cXsSgqj3nLtY
Sep 10 19:15:21 devstack quobyte-client[82855]: Registry: osci01.corp.quobyte.com:7861
Sep 10 19:15:21 devstack quobyte-client[82855]: Volume: cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:15:21 devstack quobyte-client[82855]: FUSE version: 316
Sep 10 19:15:21 devstack quobyte-client[82855]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 10 19:15:21 devstack quobyte-client[82855]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 10 19:15:21 devstack quobyte-client[82855]: Setting total object cache size to 3352297472 bytes
Sep 10 19:15:21 devstack quobyte-client[82855]: Using FUSE low-level API
Sep 10 19:15:21 devstack quobyte-client[82855]: Caching of uid/gid to user/group name mappings is enabled
Sep 10 19:15:21 devstack quobyte-client[82855]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 10 19:15:21 devstack quobyte-client[82855]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 10 19:15:21 devstack quobyte-client[82855]: HTTP server started on port 55000
Sep 10 19:15:21 devstack quobyte-client[82855]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 10 19:15:21 devstack quobyte-client[82855]: Mount point /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba established
Sep 10 19:15:21 devstack quobyte-client[82855]: TimeSync is running and remote sync every 60 seconds
Sep 10 19:15:21 devstack quobyte-client[82855]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 19:15:21 devstack quobyte-client[82855]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 19:15:21 devstack quobyte-client[82855]: Opening volume cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a (0cb7a17d-c4b2-4e14-8c86-258d5e55517f)
Sep 10 19:15:21 devstack quobyte-client[82855]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 10 19:15:21 devstack quobyte-client[82855]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 19:15:21 devstack quobyte-client[82855]: Failed to invalidate inode: 38: Function not implemented
Sep 10 19:15:21 devstack quobyte-client[82855]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 19:15:21 devstack quobyte-client[82855]: Automatic minidump upload enabled by global system configuration
Sep 10 19:15:21 devstack quobyte-client[82855]: Announcing HTTP status server address 172.24.4.1
Sep 10 19:15:21 devstack quobyte-client[82855]: Registered as service (uuid ojGNwcV3-uBGm-7bw7-ekxB-cXsSgqj3nLtY)
Sep 10 19:15:21 devstack quobyte-client[82855]: Quobyte Client running as pid 82855
Sep 10 19:15:21 devstack quobyte-client[82855]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 10 19:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.939s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:21 devstack quobyte-client[82855]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 10 19:15:21 devstack cinder-volume[82850]: INFO cinder.volume.drivers.quobyte [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Mounting volume: 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a succeeded
Sep 10 19:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 1.021s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:21 devstack quobyte-client[82855]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 19:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.123s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:22 devstack cinder-volume[82850]: INFO cinder.volume.driver [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Driver hasn't implemented _init_vendor_properties()
Sep 10 19:15:22 devstack cinder-volume[82850]: DEBUG cinder.volume.driver [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.8652381896973, 'free_capacity_gb': 924.8652381896973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82850) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 10 19:15:22 devstack cinder-volume[82850]: DEBUG oslo_db.sqlalchemy.engines [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82850) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 19:15:22 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writer thread running {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 19:15:22 devstack cinder-volume[82850]: DEBUG cinder.db.sqlalchemy.api [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Building query based on filter {{(pid=82850) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 10 19:15:22 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82850) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 10 19:15:22 devstack cinder-volume[82850]: INFO cinder.keymgr.migration [None req-5cd4266b-b596-41ae-8734-13ac04cc3b8b None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 10 19:15:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.117s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:22 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:15:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Driver initialization completed successfully.
Sep 10 19:15:23 devstack cinder-volume[82850]: INFO cinder.manager [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Initiating service 3 cleanup
Sep 10 19:15:23 devstack cinder-volume[82850]: INFO cinder.manager [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Service 3 cleanup completed.
Sep 10 19:15:23 devstack cinder-volume[82850]: DEBUG cinder.service [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Creating RPC server for service cinder-volume {{(pid=82850) start /opt/stack/cinder/cinder/service.py:239}}
Sep 10 19:15:23 devstack cinder-volume[82850]: DEBUG cinder.service [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82850) start /opt/stack/cinder/cinder/service.py:245}}
Sep 10 19:15:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 10 19:15:23 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:23 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.113s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-190a554b-8bb2-4b5a-98f5-66d3626a42dc None None] Driver post RPC initialization completed successfully.
Sep 10 19:15:24 devstack quobyte-client[82855]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 19:15:28 devstack cinder-volume[82606]: DEBUG dbcounter [-] [82606] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:15:33 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=3 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:15:33 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:17:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:17:02 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Flow 'volume_create_manager' (0f060e33-631b-40a9-830d-b21a2b915937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf2f8c4-b296-4d58-8334-c667d840d00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf2f8c4-b296-4d58-8334-c667d840d00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-403503583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0dbf188-0979-4c04-8342-2e68a2a49224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d424e4d12684287b9e6990ff7dea6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:17:02Z,use_quota=True,user_id='f945a9ba382141bda8786ca054fa5b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064ecfde-108e-420e-a90d-ea63e9e3220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064ecfde-108e-420e-a90d-ea63e9e3220d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e345e752-f640-45a4-aca4-3f1b795aef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e345e752-f640-45a4-aca4-3f1b795aef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0dbf188-0979-4c04-8342-2e68a2a49224', 'volume_name': 'volume-d0dbf188-0979-4c04-8342-2e68a2a49224', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce3878e-041c-4b0c-bafe-4b1689419297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce3878e-041c-4b0c-bafe-4b1689419297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30160299-5102-48d0-8c4e-f96c55ccea0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:03 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Volume d0dbf188-0979-4c04-8342-2e68a2a49224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0dbf188-0979-4c04-8342-2e68a2a49224', 'volume_size': 1}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-403503583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0dbf188-0979-4c04-8342-2e68a2a49224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d424e4d12684287b9e6990ff7dea6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:17:02Z,use_quota=True,user_id='f945a9ba382141bda8786ca054fa5b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Creating volume d0dbf188-0979-4c04-8342-2e68a2a49224 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:17:03 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:17:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d0dbf188-0979-4c04-8342-2e68a2a49224 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:03 devstack quobyte-client[82855]: System call of process 83209 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:17:04 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=2, name=volume-d0dbf188-0979-4c04-8342-2e68a2a49224, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:17:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d0dbf188-0979-4c04-8342-2e68a2a49224 1073741824" returned: 0 in 1.362s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d0dbf188-0979-4c04-8342-2e68a2a49224 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d0dbf188-0979-4c04-8342-2e68a2a49224" returned: 0 in 0.120s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] <== create_volume: return (1568ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:17:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30160299-5102-48d0-8c4e-f96c55ccea0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0dbf188-0979-4c04-8342-2e68a2a49224', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f636628d-fd3b-4f5d-a7cb-dbec613d6c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:05 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Volume volume-d0dbf188-0979-4c04-8342-2e68a2a49224 (d0dbf188-0979-4c04-8342-2e68a2a49224): created successfully
Sep 10 19:17:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f636628d-fd3b-4f5d-a7cb-dbec613d6c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Flow 'volume_create_manager' (0f060e33-631b-40a9-830d-b21a2b915937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:17:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-97780b31-7b08-48fa-94f9-baf1a42fd98b tempest-VolumesAssistedSnapshotsTest-130208995 None] Created volume successfully.
Sep 10 19:17:12 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.109s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:13 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:17:15 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=3 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:17:15 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:17:33 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:17:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:17:45 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Flow 'volume_create_manager' (cbc3a48e-544e-4f39-b6b6-88b2092efcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b1cb27-5526-435f-9841-3971bf01f182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b1cb27-5526-435f-9841-3971bf01f182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-373703156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7bf4e3-62b7-48f5-9350-b4344452d5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbc216ad530406989fdcd1e5dadf74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:17:45Z,use_quota=True,user_id='16525ee378c14dab8f5d66f50715a327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a8f04b-cd19-41bf-a627-8fc402fe509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a8f04b-cd19-41bf-a627-8fc402fe509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124eb7f3-a23a-4b5b-8746-9f886a3e9ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124eb7f3-a23a-4b5b-8746-9f886a3e9ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc7bf4e3-62b7-48f5-9350-b4344452d5a4', 'volume_name': 'volume-dc7bf4e3-62b7-48f5-9350-b4344452d5a4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1e7a1f-307e-4dd3-8bf7-cdc04b9d8378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1e7a1f-307e-4dd3-8bf7-cdc04b9d8378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9f4a0b-5679-40e6-a67c-ff9820ad346a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:45 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Volume dc7bf4e3-62b7-48f5-9350-b4344452d5a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc7bf4e3-62b7-48f5-9350-b4344452d5a4', 'volume_size': 1}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-373703156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7bf4e3-62b7-48f5-9350-b4344452d5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbc216ad530406989fdcd1e5dadf74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:17:45Z,use_quota=True,user_id='16525ee378c14dab8f5d66f50715a327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Creating volume dc7bf4e3-62b7-48f5-9350-b4344452d5a4 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:17:45 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:17:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dc7bf4e3-62b7-48f5-9350-b4344452d5a4 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:46 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=3, name=volume-dc7bf4e3-62b7-48f5-9350-b4344452d5a4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:17:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dc7bf4e3-62b7-48f5-9350-b4344452d5a4 1073741824" returned: 0 in 1.043s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dc7bf4e3-62b7-48f5-9350-b4344452d5a4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dc7bf4e3-62b7-48f5-9350-b4344452d5a4" returned: 0 in 0.452s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] <== create_volume: return (1860ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:17:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9f4a0b-5679-40e6-a67c-ff9820ad346a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc7bf4e3-62b7-48f5-9350-b4344452d5a4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567f7de6-1f2f-4221-aea4-787669ecbb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:49 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Volume volume-dc7bf4e3-62b7-48f5-9350-b4344452d5a4 (dc7bf4e3-62b7-48f5-9350-b4344452d5a4): created successfully
Sep 10 19:17:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567f7de6-1f2f-4221-aea4-787669ecbb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Flow 'volume_create_manager' (cbc3a48e-544e-4f39-b6b6-88b2092efcc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:17:49 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c8f7da34-d1ae-475d-9975-e31226cd4fc7 tempest-VolumesAdminNegativeTest-716984329 None] Created volume successfully.
Sep 10 19:17:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Acquiring lock "cinder-dc7bf4e3-62b7-48f5-9350-b4344452d5a4-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:17:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Lock "cinder-dc7bf4e3-62b7-48f5-9350-b4344452d5a4-delete_volume" acquired by "delete_volume" :: waited 0.201s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:17:53 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:17:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Acquiring lock "cinder-quobyte-dc7bf4e3-62b7-48f5-9350-b4344452d5a4" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:17:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Lock "cinder-quobyte-dc7bf4e3-62b7-48f5-9350-b4344452d5a4" acquired by "delete_volume" :: waited 0.054s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:17:53 devstack cinder-volume[82850]: INFO oslo.privsep.daemon [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmploh_36fe/privsep.sock']
Sep 10 19:17:54 devstack sudo[83851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmploh_36fe/privsep.sock
Sep 10 19:17:54 devstack sudo[83851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:18:03 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:18:03 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:18:12 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:18:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:18:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:18:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:18:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:18:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:18:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.449s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:13 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:18:20 devstack sudo[83851]: pam_unix(sudo:session): session closed for user root
Sep 10 19:18:20 devstack cinder-volume[82850]: INFO oslo.privsep.daemon [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Spawned new privsep daemon via rootwrap
Sep 10 19:18:20 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Accepted privsep connection to /tmp/tmploh_36fe/privsep.sock {{(pid=82850) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 10 19:18:20 devstack cinder-volume[82850]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 10 19:18:20 devstack cinder-volume[82850]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 10 19:18:20 devstack cinder-volume[82850]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 10 19:18:20 devstack cinder-volume[82850]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83899
Sep 10 19:18:20 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[912a8663-b932-4364-ab64-05f099c78daa]: (2,) {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:18:20 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f332562e-452a-4661-94bc-529b814c98cd]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:18:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dc7bf4e3-62b7-48f5-9350-b4344452d5a4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:22 devstack quobyte-client[82855]: System call of process 83962 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:18:22 devstack quobyte-client[82855]: System call of process 83962 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:18:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dc7bf4e3-62b7-48f5-9350-b4344452d5a4" returned: 0 in 2.151s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dc7bf4e3-62b7-48f5-9350-b4344452d5a4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dc7bf4e3-62b7-48f5-9350-b4344452d5a4" returned: 0 in 0.333s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Lock "cinder-quobyte-dc7bf4e3-62b7-48f5-9350-b4344452d5a4" released by "delete_volume" :: held 30.246s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:18:25 devstack cinder-volume[82850]: WARNING cinder.quota [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:18:25 devstack cinder-volume[82850]: WARNING cinder.quota [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:18:25 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Created reservations ['f12402a3-9d26-47e5-b70c-299429a50cf9', 'a5a58f22-1e9b-41d3-804d-9928a81d1c7c', '34c23425-24ee-4fea-a2a3-c2cc443d66e6', 'a81b5f9c-3050-43e2-9519-92b27a952687'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:18:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:18:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:18:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:18:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.279s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:26 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:18:27 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Deleted volume successfully.
Sep 10 19:18:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e382e685-5139-4ac9-9294-5ae1df9ba8ad tempest-VolumesAdminNegativeTest-716984329 None] Lock "cinder-dc7bf4e3-62b7-48f5-9350-b4344452d5a4-delete_volume" released by "delete_volume" :: held 35.219s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:18:36 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:18:37 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:19:12 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:19:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:19:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:19:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:19:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:19:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:19:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:19:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.135s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:19:13 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:19:16 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Flow 'volume_create_manager' (e7761cf8-7d67-4372-bd69-43f4fd3a3849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8deef940-9d88-44b7-9446-1bbe20b794a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8deef940-9d88-44b7-9446-1bbe20b794a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1574662181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccd13e9-310c-4259-8755-e654fc95b6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='814630c896ca407c98426ad28bb3b489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:19:16Z,use_quota=True,user_id='093e49c947b74720b77a0a92775944ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b874e3db-4e51-4b54-8875-390c51666e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b874e3db-4e51-4b54-8875-390c51666e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6076861b-3e14-4bee-ad78-70f97c0b8dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6076861b-3e14-4bee-ad78-70f97c0b8dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fccd13e9-310c-4259-8755-e654fc95b6c5', 'volume_name': 'volume-fccd13e9-310c-4259-8755-e654fc95b6c5', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888b1ef2-cb97-4d92-85fd-2664819c77cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888b1ef2-cb97-4d92-85fd-2664819c77cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01449725-8a49-4885-af35-caa17e8b7285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:19:17 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Volume fccd13e9-310c-4259-8755-e654fc95b6c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fccd13e9-310c-4259-8755-e654fc95b6c5', 'volume_size': 1}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1574662181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccd13e9-310c-4259-8755-e654fc95b6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='814630c896ca407c98426ad28bb3b489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:19:16Z,use_quota=True,user_id='093e49c947b74720b77a0a92775944ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Creating volume fccd13e9-310c-4259-8755-e654fc95b6c5 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:19:17 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fccd13e9-310c-4259-8755-e654fc95b6c5 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:19:17 devstack quobyte-client[82855]: System call of process 84206 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:19:17 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=4, name=volume-fccd13e9-310c-4259-8755-e654fc95b6c5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:19:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fccd13e9-310c-4259-8755-e654fc95b6c5 1073741824" returned: 0 in 0.829s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:19:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fccd13e9-310c-4259-8755-e654fc95b6c5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:19:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fccd13e9-310c-4259-8755-e654fc95b6c5" returned: 0 in 0.227s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:19:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] <== create_volume: return (1226ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:19:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:19:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01449725-8a49-4885-af35-caa17e8b7285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fccd13e9-310c-4259-8755-e654fc95b6c5', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:19:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e83fb7-544c-4d36-9472-307532cfeac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:19:19 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Volume volume-fccd13e9-310c-4259-8755-e654fc95b6c5 (fccd13e9-310c-4259-8755-e654fc95b6c5): created successfully
Sep 10 19:19:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e83fb7-544c-4d36-9472-307532cfeac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:19:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Flow 'volume_create_manager' (e7761cf8-7d67-4372-bd69-43f4fd3a3849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:19:19 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8081acd9-25e0-4b90-b890-ec7f3519a32b tempest-AttachSCSIVolumeTestJSON-15444702 None] Created volume successfully.
Sep 10 19:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-8feb0618-af2f-4290-955b-18faf8b48a96 req-eb779cfb-b6f6-4bd8-b131-b9b4f414c55c tempest-VolumesAssistedSnapshotsTest-130208995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-8feb0618-af2f-4290-955b-18faf8b48a96 req-eb779cfb-b6f6-4bd8-b131-b9b4f414c55c tempest-VolumesAssistedSnapshotsTest-130208995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:19:30 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[416020e4-7f51-4b59-a9c7-ee04625a13b9]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-8feb0618-af2f-4290-955b-18faf8b48a96 req-eb779cfb-b6f6-4bd8-b131-b9b4f414c55c tempest-VolumesAssistedSnapshotsTest-130208995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d0dbf188-0979-4c04-8342-2e68a2a49224 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-9628c7e1-2929-40bc-8670-e4a78487f318 req-eb252c98-fc1b-4320-ae14-92ccc4b0d351 tempest-AttachSCSIVolumeTestJSON-15444702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-8feb0618-af2f-4290-955b-18faf8b48a96 req-eb779cfb-b6f6-4bd8-b131-b9b4f414c55c tempest-VolumesAssistedSnapshotsTest-130208995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d0dbf188-0979-4c04-8342-2e68a2a49224" returned: 0 in 0.581s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-8feb0618-af2f-4290-955b-18faf8b48a96 req-eb779cfb-b6f6-4bd8-b131-b9b4f414c55c tempest-VolumesAssistedSnapshotsTest-130208995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.623s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-9628c7e1-2929-40bc-8670-e4a78487f318 req-eb252c98-fc1b-4320-ae14-92ccc4b0d351 tempest-AttachSCSIVolumeTestJSON-15444702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.424s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:19:30 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b2fb26-dc6e-4731-a899-ee6dad435573]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-9628c7e1-2929-40bc-8670-e4a78487f318 req-eb252c98-fc1b-4320-ae14-92ccc4b0d351 tempest-AttachSCSIVolumeTestJSON-15444702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fccd13e9-310c-4259-8755-e654fc95b6c5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:19:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-8feb0618-af2f-4290-955b-18faf8b48a96 req-eb779cfb-b6f6-4bd8-b131-b9b4f414c55c tempest-VolumesAssistedSnapshotsTest-130208995 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-d0dbf188-0979-4c04-8342-2e68a2a49224', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bd2f310-63b9-4d59-bab6-bc0c1e199d8d', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:19:31 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-8feb0618-af2f-4290-955b-18faf8b48a96 req-eb779cfb-b6f6-4bd8-b131-b9b4f414c55c tempest-VolumesAssistedSnapshotsTest-130208995 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:19:31 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-8feb0618-af2f-4290-955b-18faf8b48a96 req-eb779cfb-b6f6-4bd8-b131-b9b4f414c55c tempest-VolumesAssistedSnapshotsTest-130208995 None] attachment_update completed successfully.
Sep 10 19:19:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-9628c7e1-2929-40bc-8670-e4a78487f318 req-eb252c98-fc1b-4320-ae14-92ccc4b0d351 tempest-AttachSCSIVolumeTestJSON-15444702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fccd13e9-310c-4259-8755-e654fc95b6c5" returned: 0 in 0.709s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:19:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-9628c7e1-2929-40bc-8670-e4a78487f318 req-eb252c98-fc1b-4320-ae14-92ccc4b0d351 tempest-AttachSCSIVolumeTestJSON-15444702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.818s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:19:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-9628c7e1-2929-40bc-8670-e4a78487f318 req-eb252c98-fc1b-4320-ae14-92ccc4b0d351 tempest-AttachSCSIVolumeTestJSON-15444702 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-fccd13e9-310c-4259-8755-e654fc95b6c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f362ea7-ccdb-46a7-bce5-d79b8823acfe', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:19:31 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-9628c7e1-2929-40bc-8670-e4a78487f318 req-eb252c98-fc1b-4320-ae14-92ccc4b0d351 tempest-AttachSCSIVolumeTestJSON-15444702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:19:31 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-9628c7e1-2929-40bc-8670-e4a78487f318 req-eb252c98-fc1b-4320-ae14-92ccc4b0d351 tempest-AttachSCSIVolumeTestJSON-15444702 None] attachment_update completed successfully.
Sep 10 19:19:41 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:19:41 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=6,cinder:DELETE=1,cinder:SELECT=12 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:20:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-19f52ef9-2676-466b-a2a7-e62f4e252ddf req-fcc646c2-1f7e-44f2-a607-cbc4297918eb tempest-AttachSCSIVolumeTestJSON-15444702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:20:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-19f52ef9-2676-466b-a2a7-e62f4e252ddf req-fcc646c2-1f7e-44f2-a607-cbc4297918eb tempest-AttachSCSIVolumeTestJSON-15444702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:20:02 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-19f52ef9-2676-466b-a2a7-e62f4e252ddf req-fcc646c2-1f7e-44f2-a607-cbc4297918eb tempest-AttachSCSIVolumeTestJSON-15444702 None] Terminate volume connection completed successfully.
Sep 10 19:20:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-19f52ef9-2676-466b-a2a7-e62f4e252ddf req-fcc646c2-1f7e-44f2-a607-cbc4297918eb tempest-AttachSCSIVolumeTestJSON-15444702 None] Deleting attachment 8f362ea7-ccdb-46a7-bce5-d79b8823acfe. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:20:03 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-c3112d24-d794-4044-a0ee-18f29b7bafc8 req-499d04e9-7ec8-44ea-8194-2957aba3e327 tempest-VolumesAssistedSnapshotsTest-130208995 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:20:03 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-c3112d24-d794-4044-a0ee-18f29b7bafc8 req-499d04e9-7ec8-44ea-8194-2957aba3e327 tempest-VolumesAssistedSnapshotsTest-130208995 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:20:03 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-c3112d24-d794-4044-a0ee-18f29b7bafc8 req-499d04e9-7ec8-44ea-8194-2957aba3e327 tempest-VolumesAssistedSnapshotsTest-130208995 None] Terminate volume connection completed successfully.
Sep 10 19:20:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-c3112d24-d794-4044-a0ee-18f29b7bafc8 req-499d04e9-7ec8-44ea-8194-2957aba3e327 tempest-VolumesAssistedSnapshotsTest-130208995 None] Deleting attachment 3bd2f310-63b9-4d59-bab6-bc0c1e199d8d. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:20:03 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:20:03 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Flow 'volume_create_manager' (56fc5cbc-b2ca-417c-a1aa-2ada45bac76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ca651f-874d-4a87-8c62-1c967f4cf5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ca651f-874d-4a87-8c62-1c967f4cf5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-394416484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a892b0-85d4-4627-8121-1a69ccb3623b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8f950bcc8548cf9e24c7054361efc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:20:04Z,use_quota=True,user_id='6974824e338b48c9879fbf0ea10cc2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86b4f05-59e1-40e9-950e-cea4853b41d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86b4f05-59e1-40e9-950e-cea4853b41d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a2d535-cd3a-42a7-835f-1dbe3588562b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a2d535-cd3a-42a7-835f-1dbe3588562b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2a892b0-85d4-4627-8121-1a69ccb3623b', 'volume_name': 'volume-f2a892b0-85d4-4627-8121-1a69ccb3623b', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ac6ce9-b788-4665-8e8e-f8bee2f6a309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ac6ce9-b788-4665-8e8e-f8bee2f6a309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e79593-11ac-44d0-b9e3-480d76beeaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:20:04 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Volume f2a892b0-85d4-4627-8121-1a69ccb3623b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2a892b0-85d4-4627-8121-1a69ccb3623b', 'volume_size': 1}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-394416484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a892b0-85d4-4627-8121-1a69ccb3623b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8f950bcc8548cf9e24c7054361efc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:20:04Z,use_quota=True,user_id='6974824e338b48c9879fbf0ea10cc2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Creating volume f2a892b0-85d4-4627-8121-1a69ccb3623b {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:20:04 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f2a892b0-85d4-4627-8121-1a69ccb3623b 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:04 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=5, name=volume-f2a892b0-85d4-4627-8121-1a69ccb3623b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f2a892b0-85d4-4627-8121-1a69ccb3623b 1073741824" returned: 0 in 0.462s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f2a892b0-85d4-4627-8121-1a69ccb3623b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f2a892b0-85d4-4627-8121-1a69ccb3623b" returned: 0 in 0.145s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] <== create_volume: return (688ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:20:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:20:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e79593-11ac-44d0-b9e3-480d76beeaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2a892b0-85d4-4627-8121-1a69ccb3623b', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:20:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54b142b-8c06-4678-b082-5e2ff2fd5cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:20:05 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Volume volume-f2a892b0-85d4-4627-8121-1a69ccb3623b (f2a892b0-85d4-4627-8121-1a69ccb3623b): created successfully
Sep 10 19:20:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54b142b-8c06-4678-b082-5e2ff2fd5cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:20:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Flow 'volume_create_manager' (56fc5cbc-b2ca-417c-a1aa-2ada45bac76a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:20:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-978f5081-084b-44d4-9038-71a37b78f1d6 tempest-DeleteServersTestJSON-1846520349 None] Created volume successfully.
Sep 10 19:20:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Acquiring lock "cinder-d0dbf188-0979-4c04-8342-2e68a2a49224-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:20:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Lock "cinder-d0dbf188-0979-4c04-8342-2e68a2a49224-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:20:06 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:20:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Acquiring lock "cinder-quobyte-d0dbf188-0979-4c04-8342-2e68a2a49224" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:20:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Lock "cinder-quobyte-d0dbf188-0979-4c04-8342-2e68a2a49224" acquired by "delete_volume" :: waited 0.053s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:20:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[84695962-8ba5-40b0-b59d-154924429d01]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:20:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d0dbf188-0979-4c04-8342-2e68a2a49224 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d0dbf188-0979-4c04-8342-2e68a2a49224" returned: 0 in 0.923s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d0dbf188-0979-4c04-8342-2e68a2a49224 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d0dbf188-0979-4c04-8342-2e68a2a49224" returned: 0 in 0.492s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Lock "cinder-quobyte-d0dbf188-0979-4c04-8342-2e68a2a49224" released by "delete_volume" :: held 2.380s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:20:09 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Created reservations ['43a896b1-b270-4e0e-87d6-bfaa01a6a978', 'dc8a5774-f2b7-43b2-96f8-5d4e51ad3010', '754f77d0-da6f-4fb4-a150-f1910cc61485', 'f9240926-3871-41b2-9ef1-d465cc7fcb95'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:20:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:20:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:20:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:20:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:20:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:20:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.137s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:10 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:20:10 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Deleted volume successfully.
Sep 10 19:20:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-204f43a9-00fe-4ba8-b8fd-3a4ec8229281 tempest-VolumesAssistedSnapshotsTest-130208995 None] Lock "cinder-d0dbf188-0979-4c04-8342-2e68a2a49224-delete_volume" released by "delete_volume" :: held 4.226s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:20:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-0729cc15-ba7f-486d-8e2a-8fa11bc64cf4 req-d1e00951-6c2a-4401-9619-380487f01d14 tempest-DeleteServersTestJSON-1846520349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:20:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-0729cc15-ba7f-486d-8e2a-8fa11bc64cf4 req-d1e00951-6c2a-4401-9619-380487f01d14 tempest-DeleteServersTestJSON-1846520349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:20:12 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bce79e0-279c-4f17-b509-281159776642]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:20:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-0729cc15-ba7f-486d-8e2a-8fa11bc64cf4 req-d1e00951-6c2a-4401-9619-380487f01d14 tempest-DeleteServersTestJSON-1846520349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f2a892b0-85d4-4627-8121-1a69ccb3623b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:13 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:20:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:20:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:20:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:20:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:20:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.416s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:20:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:15 devstack quobyte-client[82855]: System call of process 84899 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:20:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-0729cc15-ba7f-486d-8e2a-8fa11bc64cf4 req-d1e00951-6c2a-4401-9619-380487f01d14 tempest-DeleteServersTestJSON-1846520349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f2a892b0-85d4-4627-8121-1a69ccb3623b" returned: 0 in 3.434s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-0729cc15-ba7f-486d-8e2a-8fa11bc64cf4 req-d1e00951-6c2a-4401-9619-380487f01d14 tempest-DeleteServersTestJSON-1846520349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.748s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:20:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 2.512s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:16 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:20:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-0729cc15-ba7f-486d-8e2a-8fa11bc64cf4 req-d1e00951-6c2a-4401-9619-380487f01d14 tempest-DeleteServersTestJSON-1846520349 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-f2a892b0-85d4-4627-8121-1a69ccb3623b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a35dd097-8b02-4746-a439-55f9933a6543', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:20:17 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-0729cc15-ba7f-486d-8e2a-8fa11bc64cf4 req-d1e00951-6c2a-4401-9619-380487f01d14 tempest-DeleteServersTestJSON-1846520349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:20:17 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-0729cc15-ba7f-486d-8e2a-8fa11bc64cf4 req-d1e00951-6c2a-4401-9619-380487f01d14 tempest-DeleteServersTestJSON-1846520349 None] attachment_update completed successfully.
Sep 10 19:20:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Acquiring lock "cinder-fccd13e9-310c-4259-8755-e654fc95b6c5-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:20:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Lock "cinder-fccd13e9-310c-4259-8755-e654fc95b6c5-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:20:25 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:20:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Acquiring lock "cinder-quobyte-fccd13e9-310c-4259-8755-e654fc95b6c5" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:20:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Lock "cinder-quobyte-fccd13e9-310c-4259-8755-e654fc95b6c5" acquired by "delete_volume" :: waited 0.091s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:20:25 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c2ae95-39cc-4f4b-91a7-42dfb824064f]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:20:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fccd13e9-310c-4259-8755-e654fc95b6c5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fccd13e9-310c-4259-8755-e654fc95b6c5" returned: 0 in 0.761s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fccd13e9-310c-4259-8755-e654fc95b6c5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fccd13e9-310c-4259-8755-e654fc95b6c5" returned: 0 in 0.215s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Lock "cinder-quobyte-fccd13e9-310c-4259-8755-e654fc95b6c5" released by "delete_volume" :: held 1.162s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:20:27 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Created reservations ['da606914-9bd3-4aa5-a1f7-701df6723837', '681cf8e0-d339-45e0-b9bd-33fc1543aed6', 'ac3fd98c-4c1b-473e-8ffe-383bca436b8f', '8ab3bf61-0e8d-433d-bb4f-b7080ba93db5'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:20:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:20:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:20:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:20:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:20:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:20:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.145s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:27 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:20:27 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Deleted volume successfully.
Sep 10 19:20:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-87713203-7cc7-4c62-9a42-85571a79d5cc tempest-AttachSCSIVolumeTestJSON-15444702 None] Lock "cinder-fccd13e9-310c-4259-8755-e654fc95b6c5-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:20:37 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=17,cinder:UPDATE=18,cinder:DELETE=1,cinder:INSERT=3 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:20:38 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=20,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:20:41 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-4ace6a9a-639c-4603-a6a8-fab89f5cc164 req-1e77f82b-c842-46bd-b301-a7d3c713288f tempest-DeleteServersTestJSON-1846520349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:20:41 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-4ace6a9a-639c-4603-a6a8-fab89f5cc164 req-1e77f82b-c842-46bd-b301-a7d3c713288f tempest-DeleteServersTestJSON-1846520349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:20:41 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-4ace6a9a-639c-4603-a6a8-fab89f5cc164 req-1e77f82b-c842-46bd-b301-a7d3c713288f tempest-DeleteServersTestJSON-1846520349 None] Terminate volume connection completed successfully.
Sep 10 19:20:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-4ace6a9a-639c-4603-a6a8-fab89f5cc164 req-1e77f82b-c842-46bd-b301-a7d3c713288f tempest-DeleteServersTestJSON-1846520349 None] Deleting attachment a35dd097-8b02-4746-a439-55f9933a6543. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:20:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Acquiring lock "cinder-f2a892b0-85d4-4627-8121-1a69ccb3623b-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:20:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Lock "cinder-f2a892b0-85d4-4627-8121-1a69ccb3623b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:20:47 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:20:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Acquiring lock "cinder-quobyte-f2a892b0-85d4-4627-8121-1a69ccb3623b" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:20:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Lock "cinder-quobyte-f2a892b0-85d4-4627-8121-1a69ccb3623b" acquired by "delete_volume" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:20:47 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[68136f95-fa75-48db-9f34-792cb6a45aa5]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:20:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f2a892b0-85d4-4627-8121-1a69ccb3623b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f2a892b0-85d4-4627-8121-1a69ccb3623b" returned: 0 in 0.766s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f2a892b0-85d4-4627-8121-1a69ccb3623b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f2a892b0-85d4-4627-8121-1a69ccb3623b" returned: 0 in 0.179s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Lock "cinder-quobyte-f2a892b0-85d4-4627-8121-1a69ccb3623b" released by "delete_volume" :: held 1.123s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:20:49 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Created reservations ['04c8c9af-b336-4b7c-8717-755c2644a305', '6219d031-ce22-4af0-a748-449b6edd4df7', '0a6ae46e-46d9-4a9d-abf1-f99dbbffc91f', 'd91a8652-c3f4-4876-86a7-2ed6042fa922'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:20:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:20:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:20:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:20:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:20:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:20:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.117s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:49 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:20:49 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Deleted volume successfully.
Sep 10 19:20:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a78106a9-416f-4345-ad2e-f7ea73355647 tempest-DeleteServersTestJSON-1846520349 None] Lock "cinder-f2a892b0-85d4-4627-8121-1a69ccb3623b-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:20:59 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:INSERT=4 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:20:59 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:21:12 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:21:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:21:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:21:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:21:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:21:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:21:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.190s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:13 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:21:33 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:21:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:21:45 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Flow 'volume_create_manager' (63067ac8-f144-4e6b-be01-f59ac4957626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e3995e-c9aa-42fc-8c26-417af1eb958b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e3995e-c9aa-42fc-8c26-417af1eb958b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-312718873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46dc8e56b445c8824a1f35818cb51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:21:45Z,use_quota=True,user_id='54f2c5c8ecf2451e98eaf22b1f2df4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f1f6db-3462-49d7-86ea-5becb92c8434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f1f6db-3462-49d7-86ea-5becb92c8434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4ece35-cb9d-426a-a045-0d963ef6132f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4ece35-cb9d-426a-a045-0d963ef6132f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9', 'volume_name': 'volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a3a65d-f76d-45a1-b8b0-dab8eb930597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a3a65d-f76d-45a1-b8b0-dab8eb930597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ed8646-29b5-445d-8f79-c5179d5eb6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:21:45 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Volume 9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9', 'volume_size': 1}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-312718873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46dc8e56b445c8824a1f35818cb51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:21:45Z,use_quota=True,user_id='54f2c5c8ecf2451e98eaf22b1f2df4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Creating volume 9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:21:45 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:21:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:46 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=6, name=volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:21:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9 1073741824" returned: 0 in 0.427s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9" returned: 0 in 0.093s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] <== create_volume: return (601ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:21:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.613s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:21:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ed8646-29b5-445d-8f79-c5179d5eb6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:21:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0117c5f-b15d-4095-ad25-2298416a8367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:21:46 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Volume volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9 (9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9): created successfully
Sep 10 19:21:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0117c5f-b15d-4095-ad25-2298416a8367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:21:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Flow 'volume_create_manager' (63067ac8-f144-4e6b-be01-f59ac4957626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:21:46 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4f3d77fe-2665-441a-9449-5c835ed7b6ae tempest-TaggedAttachmentsTest-1684326993 None] Created volume successfully.
Sep 10 19:21:56 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=4 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:21:56 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=2,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:22:09 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:22:09 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:22:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Flow 'volume_create_manager' (387487d9-4ca1-49a5-bd50-5ccbd1079cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:22:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973e5d3e-f6c5-4c58-adcc-79ebb184774e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973e5d3e-f6c5-4c58-adcc-79ebb184774e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1338193782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e30141d-c398-4eb8-9f97-820148e5b062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43c3869f437a423691b362e441fe423d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:22:09Z,use_quota=True,user_id='625853b5b34c48d3a7f49e709df85e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8fd540-f87e-4f6c-89e0-264621b12666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8fd540-f87e-4f6c-89e0-264621b12666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2479cd-ab90-4e87-88ed-edef2c3c4f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2479cd-ab90-4e87-88ed-edef2c3c4f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5e30141d-c398-4eb8-9f97-820148e5b062', 'volume_name': 'volume-5e30141d-c398-4eb8-9f97-820148e5b062', 'volume_size': 1, 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '489167b5c946434eba8a26e1f48a2447', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'created_at': datetime.datetime(2025, 9, 10, 17, 8, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/391d42a7-95bd-4118-889d-f5820ea8d60f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc5789ef520>}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d54ba1-e66f-42c2-a22a-0fc66b0daa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d54ba1-e66f-42c2-a22a-0fc66b0daa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e5ae5c-ee05-4934-a25b-e61d699b6e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:11 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Volume 5e30141d-c398-4eb8-9f97-820148e5b062: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5e30141d-c398-4eb8-9f97-820148e5b062', 'volume_size': 1, 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '489167b5c946434eba8a26e1f48a2447', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'created_at': datetime.datetime(2025, 9, 10, 17, 8, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/391d42a7-95bd-4118-889d-f5820ea8d60f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc5789ef520>}
Sep 10 19:22:11 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Cloning 5e30141d-c398-4eb8-9f97-820148e5b062 from image 391d42a7-95bd-4118-889d-f5820ea8d60f  at location (None, None). {{(pid=82850) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 19:22:12 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_zcwvfs2fdevstack@QuobyteHD, size 20.69 MB, duration 1.87 sec {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 19:22:12 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Image download 20.69 MB at 11.09 MB/s
Sep 10 19:22:13 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:22:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:22:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:22:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.072s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:14 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3a2ca4-4902-4c18-b8b2-6f4b973eea6b]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:22:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_zcwvfs2fdevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 1.271s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:22:17 devstack sudo[85659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_zcwvfs2fdevstack@QuobyteHD
Sep 10 19:22:17 devstack sudo[85659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:22:19 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:22:19 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:22:25 devstack sudo[85659]: pam_unix(sudo:session): session closed for user root
Sep 10 19:22:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_zcwvfs2fdevstack@QuobyteHD" returned: 0 in 11.531s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:25 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Temporary image 391d42a7-95bd-4118-889d-f5820ea8d60f is fetched for user 625853b5b34c48d3a7f49e709df85e5d. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 19:22:26 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6ade8d-8cfc-44d3-a290-433a9549dccb]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:22:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_zcwvfs2fdevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:26 devstack sudo[85700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_zcwvfs2fdevstack@QuobyteHD
Sep 10 19:22:26 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:22:30 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root
Sep 10 19:22:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_zcwvfs2fdevstack@QuobyteHD" returned: 0 in 4.317s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1338193782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e30141d-c398-4eb8-9f97-820148e5b062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43c3869f437a423691b362e441fe423d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:22:09Z,use_quota=True,user_id='625853b5b34c48d3a7f49e709df85e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:22:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Creating volume 5e30141d-c398-4eb8-9f97-820148e5b062 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:22:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:22:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:22:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:22:30 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:22:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:31 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=7, name=volume-5e30141d-c398-4eb8-9f97-820148e5b062, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:22:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062 1073741824" returned: 0 in 0.575s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062" returned: 0 in 0.220s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] <== create_volume: return (978ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:22:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:32 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Attempting download of 391d42a7-95bd-4118-889d-f5820ea8d60f ((None, None)) to volume 5e30141d-c398-4eb8-9f97-820148e5b062. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 19:22:32 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0175a3de-212f-44ca-8131-7f730b49c965]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:22:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_8pgjd9db {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_8pgjd9db" returned: 0 in 0.455s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_8pgjd9db {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_8pgjd9db" returned: 1 in 0.848s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_8pgjd9db' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:22:34 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3dcc23-8379-4ebb-8463-1521451aa393]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:22:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_zcwvfs2fdevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_zcwvfs2fdevstack@QuobyteHD" returned: 0 in 0.567s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:34 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] 391d42a7-95bd-4118-889d-f5820ea8d60f was qcow2, converting to raw {{(pid=82850) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 19:22:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_zcwvfs2fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:34 devstack quobyte-client[82855]: System call of process 85794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:22:35 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=7, name=volume-5e30141d-c398-4eb8-9f97-820148e5b062, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:22:36 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1,cinder:INSERT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:22:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_zcwvfs2fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062" returned: 0 in 1.957s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:36 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_zcwvfs2fdevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:22:36 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Converted 112.00 MB image at 57.02 MB/s
Sep 10 19:22:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062 1G" returned: 0 in 0.200s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:37 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5634ff8-b5b1-4b4a-98f2-2b88900606b9]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:22:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062" returned: 0 in 2.421s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:42 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:22:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062" returned: 1 in 2.439s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:22:42 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Downloaded image 391d42a7-95bd-4118-889d-f5820ea8d60f ((None, None)) to volume 5e30141d-c398-4eb8-9f97-820148e5b062 successfully. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 19:22:42 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Temporary image 391d42a7-95bd-4118-889d-f5820ea8d60f for user 625853b5b34c48d3a7f49e709df85e5d is deleted. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 19:22:42 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Marking volume 5e30141d-c398-4eb8-9f97-820148e5b062 as bootable. {{(pid=82850) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 19:22:43 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Copying metadata from image 391d42a7-95bd-4118-889d-f5820ea8d60f to 5e30141d-c398-4eb8-9f97-820148e5b062. {{(pid=82850) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 19:22:43 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Creating volume glance metadata for volume 5e30141d-c398-4eb8-9f97-820148e5b062 backed by image 391d42a7-95bd-4118-889d-f5820ea8d60f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82850) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 19:22:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e5ae5c-ee05-4934-a25b-e61d699b6e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e30141d-c398-4eb8-9f97-820148e5b062', 'volume_size': 1, 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '489167b5c946434eba8a26e1f48a2447', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'created_at': datetime.datetime(2025, 9, 10, 17, 8, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/391d42a7-95bd-4118-889d-f5820ea8d60f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc5789ef520>}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d05fdf-b091-4998-bb39-a11fb7788838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:43 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Volume volume-5e30141d-c398-4eb8-9f97-820148e5b062 (5e30141d-c398-4eb8-9f97-820148e5b062): created successfully
Sep 10 19:22:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d05fdf-b091-4998-bb39-a11fb7788838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Flow 'volume_create_manager' (387487d9-4ca1-49a5-bd50-5ccbd1079cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:22:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c8129106-1ff6-47a0-81ff-80b9b7d1c4b2 tempest-TaggedBootDevicesTest-1869332682 None] Created volume successfully.
Sep 10 19:22:46 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Flow 'volume_create_manager' (e24fcf8a-f3a6-48b6-b2aa-ee4276511e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd83b9d-b48f-406d-bc9d-d88de2fe8f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd83b9d-b48f-406d-bc9d-d88de2fe8f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-959797172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa99610-4702-4462-8df0-e1b81eb1463a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43c3869f437a423691b362e441fe423d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:22:46Z,use_quota=True,user_id='625853b5b34c48d3a7f49e709df85e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59201bca-32d7-485b-b661-db7de7f92a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59201bca-32d7-485b-b661-db7de7f92a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb265e34-2720-41d0-b0bb-228aad20f63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb265e34-2720-41d0-b0bb-228aad20f63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa99610-4702-4462-8df0-e1b81eb1463a', 'volume_name': 'volume-dfa99610-4702-4462-8df0-e1b81eb1463a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcc8be1-cfbd-4bb9-9889-0bc1b463ab1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcc8be1-cfbd-4bb9-9889-0bc1b463ab1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf85f91-1e0c-440a-bb9d-19e3d8699fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:46 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Volume dfa99610-4702-4462-8df0-e1b81eb1463a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa99610-4702-4462-8df0-e1b81eb1463a', 'volume_size': 1}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-959797172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa99610-4702-4462-8df0-e1b81eb1463a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43c3869f437a423691b362e441fe423d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:22:46Z,use_quota=True,user_id='625853b5b34c48d3a7f49e709df85e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Creating volume dfa99610-4702-4462-8df0-e1b81eb1463a {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:22:46 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:22:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfa99610-4702-4462-8df0-e1b81eb1463a 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:46 devstack quobyte-client[82855]: System call of process 85922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:22:47 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=8, name=volume-dfa99610-4702-4462-8df0-e1b81eb1463a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:22:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfa99610-4702-4462-8df0-e1b81eb1463a 1073741824" returned: 0 in 0.682s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfa99610-4702-4462-8df0-e1b81eb1463a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfa99610-4702-4462-8df0-e1b81eb1463a" returned: 0 in 0.390s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] <== create_volume: return (1282ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:22:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf85f91-1e0c-440a-bb9d-19e3d8699fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa99610-4702-4462-8df0-e1b81eb1463a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd824b56-527a-4553-8fb2-59cf614f2bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:48 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Volume volume-dfa99610-4702-4462-8df0-e1b81eb1463a (dfa99610-4702-4462-8df0-e1b81eb1463a): created successfully
Sep 10 19:22:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd824b56-527a-4553-8fb2-59cf614f2bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Flow 'volume_create_manager' (e24fcf8a-f3a6-48b6-b2aa-ee4276511e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:22:48 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-57ee6b05-9ccd-416f-a3d1-4b54251b2b02 tempest-TaggedBootDevicesTest-1869332682 None] Created volume successfully.
Sep 10 19:22:51 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Flow 'volume_create_manager' (85931455-0e15-4ba8-828e-624187376e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88139d03-2955-4682-b53a-36a6bacacd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88139d03-2955-4682-b53a-36a6bacacd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1876018741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9fba1c-513e-46d5-a41d-d7d670c032c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43c3869f437a423691b362e441fe423d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:22:51Z,use_quota=True,user_id='625853b5b34c48d3a7f49e709df85e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0221381-351b-448a-a971-fe5bec5de70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0221381-351b-448a-a971-fe5bec5de70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e02c29b-56ed-428f-97da-1078d71e4995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e02c29b-56ed-428f-97da-1078d71e4995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da9fba1c-513e-46d5-a41d-d7d670c032c4', 'volume_name': 'volume-da9fba1c-513e-46d5-a41d-d7d670c032c4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e9d513-6484-4041-83e7-97befcaba6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e9d513-6484-4041-83e7-97befcaba6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e93b154-97b0-4b3e-88a6-0a3ef6009081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:51 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Volume da9fba1c-513e-46d5-a41d-d7d670c032c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da9fba1c-513e-46d5-a41d-d7d670c032c4', 'volume_size': 1}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1876018741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9fba1c-513e-46d5-a41d-d7d670c032c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43c3869f437a423691b362e441fe423d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:22:51Z,use_quota=True,user_id='625853b5b34c48d3a7f49e709df85e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Creating volume da9fba1c-513e-46d5-a41d-d7d670c032c4 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:22:51 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:22:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-da9fba1c-513e-46d5-a41d-d7d670c032c4 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:51 devstack quobyte-client[82855]: System call of process 85934 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:22:51 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=9, name=volume-da9fba1c-513e-46d5-a41d-d7d670c032c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:22:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-da9fba1c-513e-46d5-a41d-d7d670c032c4 1073741824" returned: 0 in 0.928s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-da9fba1c-513e-46d5-a41d-d7d670c032c4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-da9fba1c-513e-46d5-a41d-d7d670c032c4" returned: 0 in 0.219s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] <== create_volume: return (1314ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:22:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e93b154-97b0-4b3e-88a6-0a3ef6009081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da9fba1c-513e-46d5-a41d-d7d670c032c4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfc7ef7-3fb8-492f-802a-ca8ff18ee861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:53 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Volume volume-da9fba1c-513e-46d5-a41d-d7d670c032c4 (da9fba1c-513e-46d5-a41d-d7d670c032c4): created successfully
Sep 10 19:22:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfc7ef7-3fb8-492f-802a-ca8ff18ee861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Flow 'volume_create_manager' (85931455-0e15-4ba8-828e-624187376e8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:22:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-eabc1002-4ee8-40a5-a65f-d26ff550ca81 tempest-TaggedBootDevicesTest-1869332682 None] Created volume successfully.
Sep 10 19:23:04 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:23:04 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=5,cinder:SELECT=8,cinder:INSERT=10,cinder:DELETE=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:23:12 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:12 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:23:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Flow 'volume_create_manager' (bbc233e5-1984-4c07-95f9-8637b9e56c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:23:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c2dd2c-6ccc-41cc-8dad-4c67ef35d534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:13 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:23:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:23:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:23:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c2dd2c-6ccc-41cc-8dad-4c67ef35d534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1403648596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aaf10d7-a1e9-4950-9346-855b6ce51797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d066404166c24f0db44bda9e138bb01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:23:12Z,use_quota=True,user_id='8a2fc3ab36d04bc5874ef58e0fb6e8db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7433dd75-5dfb-4a4a-9944-dace443b4583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7433dd75-5dfb-4a4a-9944-dace443b4583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107bd181-31bc-42c4-a1bb-d693ed56b276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107bd181-31bc-42c4-a1bb-d693ed56b276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aaf10d7-a1e9-4950-9346-855b6ce51797', 'volume_name': 'volume-7aaf10d7-a1e9-4950-9346-855b6ce51797', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b491b91c-154d-43d6-885b-ee367202e6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b491b91c-154d-43d6-885b-ee367202e6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14db4c6c-2d21-415b-a2fa-2e276e4bddcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:14 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Volume 7aaf10d7-a1e9-4950-9346-855b6ce51797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aaf10d7-a1e9-4950-9346-855b6ce51797', 'volume_size': 1}
Sep 10 19:23:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1403648596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aaf10d7-a1e9-4950-9346-855b6ce51797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d066404166c24f0db44bda9e138bb01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:23:12Z,use_quota=True,user_id='8a2fc3ab36d04bc5874ef58e0fb6e8db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:23:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Creating volume 7aaf10d7-a1e9-4950-9346-855b6ce51797 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:23:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:23:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:23:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:23:14 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:23:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7aaf10d7-a1e9-4950-9346-855b6ce51797 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 1.384s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:23:14 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=10, name=volume-7aaf10d7-a1e9-4950-9346-855b6ce51797, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:23:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7aaf10d7-a1e9-4950-9346-855b6ce51797 1073741824" returned: 0 in 0.879s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7aaf10d7-a1e9-4950-9346-855b6ce51797 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7aaf10d7-a1e9-4950-9346-855b6ce51797" returned: 0 in 0.284s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] <== create_volume: return (1319ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:23:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14db4c6c-2d21-415b-a2fa-2e276e4bddcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aaf10d7-a1e9-4950-9346-855b6ce51797', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791fa529-a355-4d25-9f9e-7cd8bff3c902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Volume volume-7aaf10d7-a1e9-4950-9346-855b6ce51797 (7aaf10d7-a1e9-4950-9346-855b6ce51797): created successfully
Sep 10 19:23:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791fa529-a355-4d25-9f9e-7cd8bff3c902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Flow 'volume_create_manager' (bbc233e5-1984-4c07-95f9-8637b9e56c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:23:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a5509532-44ac-4eea-ba78-543e5bbb3933 tempest-ServersNegativeTestJSON-1427163277 None] Created volume successfully.
Sep 10 19:23:22 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Flow 'volume_create_manager' (feb69113-7085-4d1e-ada0-9c19594d73f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa51015-be74-4110-aeef-af7b296483a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa51015-be74-4110-aeef-af7b296483a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-149938431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2806935-9548-41d0-b974-f892afb99e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d066404166c24f0db44bda9e138bb01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:23:21Z,use_quota=True,user_id='8a2fc3ab36d04bc5874ef58e0fb6e8db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16018ff-091c-4f1e-8aa5-91c5e1f980be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16018ff-091c-4f1e-8aa5-91c5e1f980be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a8c806-44b7-4f13-b5be-8ef77316d6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a8c806-44b7-4f13-b5be-8ef77316d6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2806935-9548-41d0-b974-f892afb99e13', 'volume_name': 'volume-b2806935-9548-41d0-b974-f892afb99e13', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779b0be6-a1c8-4266-bccf-db475aef8e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779b0be6-a1c8-4266-bccf-db475aef8e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd4959c-86cb-41a5-b5fa-e87f69e2bfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:22 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Volume b2806935-9548-41d0-b974-f892afb99e13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2806935-9548-41d0-b974-f892afb99e13', 'volume_size': 1}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-149938431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2806935-9548-41d0-b974-f892afb99e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d066404166c24f0db44bda9e138bb01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:23:21Z,use_quota=True,user_id='8a2fc3ab36d04bc5874ef58e0fb6e8db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Creating volume b2806935-9548-41d0-b974-f892afb99e13 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:23:22 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:23:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2806935-9548-41d0-b974-f892afb99e13 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:22 devstack quobyte-client[82855]: System call of process 86045 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:23:22 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=11, name=volume-b2806935-9548-41d0-b974-f892afb99e13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:23:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2806935-9548-41d0-b974-f892afb99e13 1073741824" returned: 0 in 0.662s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2806935-9548-41d0-b974-f892afb99e13 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2806935-9548-41d0-b974-f892afb99e13" returned: 0 in 0.244s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] <== create_volume: return (1116ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:23:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd4959c-86cb-41a5-b5fa-e87f69e2bfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2806935-9548-41d0-b974-f892afb99e13', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1738c5-9fda-4c88-b702-f5af5a8ced70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:24 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Volume volume-b2806935-9548-41d0-b974-f892afb99e13 (b2806935-9548-41d0-b974-f892afb99e13): created successfully
Sep 10 19:23:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1738c5-9fda-4c88-b702-f5af5a8ced70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Flow 'volume_create_manager' (feb69113-7085-4d1e-ada0-9c19594d73f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:23:24 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-eeef3806-3376-497c-b846-7aa5c525a455 tempest-ServersNegativeTestJSON-1427163277 None] Created volume successfully.
Sep 10 19:23:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Acquiring lock "cinder-b2806935-9548-41d0-b974-f892afb99e13-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Lock "cinder-b2806935-9548-41d0-b974-f892afb99e13-delete_volume" acquired by "delete_volume" :: waited 0.161s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:27 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Acquiring lock "cinder-quobyte-b2806935-9548-41d0-b974-f892afb99e13" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Lock "cinder-quobyte-b2806935-9548-41d0-b974-f892afb99e13" acquired by "delete_volume" :: waited 0.033s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:27 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b5b73a-e631-42be-a0e6-8d9411db1039]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2806935-9548-41d0-b974-f892afb99e13 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2806935-9548-41d0-b974-f892afb99e13" returned: 0 in 0.806s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2806935-9548-41d0-b974-f892afb99e13 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2806935-9548-41d0-b974-f892afb99e13" returned: 0 in 0.299s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Lock "cinder-quobyte-b2806935-9548-41d0-b974-f892afb99e13" released by "delete_volume" :: held 1.506s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:30 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Created reservations ['4b9f9b3e-8147-421f-a0d2-197b40b47fbb', '7d8f05c6-bfaa-4182-aad2-f1129a19ab8f', '9e8be363-2921-420a-b39a-5ebd05f6e2ba', 'cf3565e3-eb6a-4b5d-8ee5-71221b65804e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:23:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.036s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:23:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:23:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.297s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:30 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:23:30 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Deleted volume successfully.
Sep 10 19:23:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-40377640-e867-4065-9aaa-6af096983f21 tempest-ServersNegativeTestJSON-1427163277 None] Lock "cinder-b2806935-9548-41d0-b974-f892afb99e13-delete_volume" released by "delete_volume" :: held 3.926s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Acquiring lock "cinder-7aaf10d7-a1e9-4950-9346-855b6ce51797-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Lock "cinder-7aaf10d7-a1e9-4950-9346-855b6ce51797-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:31 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Acquiring lock "cinder-quobyte-7aaf10d7-a1e9-4950-9346-855b6ce51797" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Lock "cinder-quobyte-7aaf10d7-a1e9-4950-9346-855b6ce51797" acquired by "delete_volume" :: waited 0.029s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:31 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf77728-8ef3-4df8-9e4d-519ff83092c0]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7aaf10d7-a1e9-4950-9346-855b6ce51797 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7aaf10d7-a1e9-4950-9346-855b6ce51797" returned: 0 in 0.683s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7aaf10d7-a1e9-4950-9346-855b6ce51797 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7aaf10d7-a1e9-4950-9346-855b6ce51797" returned: 0 in 0.249s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Lock "cinder-quobyte-7aaf10d7-a1e9-4950-9346-855b6ce51797" released by "delete_volume" :: held 1.116s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:33 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Created reservations ['e31d0865-07e4-4d88-b085-d17baaf4a9f5', '590d5b27-0903-4777-9eff-a6d53bacf0e2', '401c9c9d-d629-4df9-8e5f-e83dea4a24a4', '5d6ca316-68ae-445d-88a0-2b130baa86c7'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:23:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:23:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:23:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.151s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:33 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:23:33 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Deleted volume successfully.
Sep 10 19:23:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5ea6ad5b-5258-4c97-83bc-12a835f3ba45 tempest-ServersNegativeTestJSON-1427163277 None] Lock "cinder-7aaf10d7-a1e9-4950-9346-855b6ce51797-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:43 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=34,cinder:SELECT=12,cinder:DELETE=1,cinder:INSERT=6 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:23:43 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=13,cinder:UPDATE=7,cinder:DELETE=3,cinder:INSERT=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:23:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-6f7170ff-574e-438f-8370-88a7d51320c9 tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-6f7170ff-574e-438f-8370-88a7d51320c9 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:46 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d462485-0fe3-4d25-a383-69a03955dc35]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-6f7170ff-574e-438f-8370-88a7d51320c9 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-6f7170ff-574e-438f-8370-88a7d51320c9 tempest-TaggedBootDevicesTest-1869332682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062" returned: 0 in 0.643s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-6f7170ff-574e-438f-8370-88a7d51320c9 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-6f7170ff-574e-438f-8370-88a7d51320c9 tempest-TaggedBootDevicesTest-1869332682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062" returned: 1 in 0.802s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-6f7170ff-574e-438f-8370-88a7d51320c9 tempest-TaggedBootDevicesTest-1869332682 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:23:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-6f7170ff-574e-438f-8370-88a7d51320c9 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.648s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-6f7170ff-574e-438f-8370-88a7d51320c9 tempest-TaggedBootDevicesTest-1869332682 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-5e30141d-c398-4eb8-9f97-820148e5b062', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e3e199b-dc1e-4843-ab6e-7ede54ae0999', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:23:48 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-6f7170ff-574e-438f-8370-88a7d51320c9 tempest-TaggedBootDevicesTest-1869332682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:48 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-6f7170ff-574e-438f-8370-88a7d51320c9 tempest-TaggedBootDevicesTest-1869332682 None] attachment_update completed successfully.
Sep 10 19:23:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-c222476d-42e5-4728-9d5b-b94cc4212cc3 tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-c222476d-42e5-4728-9d5b-b94cc4212cc3 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:51 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b51c389-fb70-4fc5-955e-315b91be20ae]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-c222476d-42e5-4728-9d5b-b94cc4212cc3 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfa99610-4702-4462-8df0-e1b81eb1463a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:51 devstack quobyte-client[82855]: System call of process 86179 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:23:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-c222476d-42e5-4728-9d5b-b94cc4212cc3 tempest-TaggedBootDevicesTest-1869332682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfa99610-4702-4462-8df0-e1b81eb1463a" returned: 0 in 0.881s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-c222476d-42e5-4728-9d5b-b94cc4212cc3 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.087s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-c222476d-42e5-4728-9d5b-b94cc4212cc3 tempest-TaggedBootDevicesTest-1869332682 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-dfa99610-4702-4462-8df0-e1b81eb1463a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d8374b9-8e5e-48e8-b8e6-d360cc62cfdb', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:23:52 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-c222476d-42e5-4728-9d5b-b94cc4212cc3 tempest-TaggedBootDevicesTest-1869332682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:52 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-c222476d-42e5-4728-9d5b-b94cc4212cc3 tempest-TaggedBootDevicesTest-1869332682 None] attachment_update completed successfully.
Sep 10 19:23:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-68e9a0b1-7ced-4abb-865b-19eaa0b03363 tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-68e9a0b1-7ced-4abb-865b-19eaa0b03363 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:56 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a843afe3-458c-4609-8aab-4e566fdaf97d]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-68e9a0b1-7ced-4abb-865b-19eaa0b03363 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-da9fba1c-513e-46d5-a41d-d7d670c032c4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-68e9a0b1-7ced-4abb-865b-19eaa0b03363 tempest-TaggedBootDevicesTest-1869332682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-da9fba1c-513e-46d5-a41d-d7d670c032c4" returned: 0 in 1.211s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-68e9a0b1-7ced-4abb-865b-19eaa0b03363 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.319s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-68e9a0b1-7ced-4abb-865b-19eaa0b03363 tempest-TaggedBootDevicesTest-1869332682 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-da9fba1c-513e-46d5-a41d-d7d670c032c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8b78df3-c13b-4941-9e67-139b96f6a104', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:23:58 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-68e9a0b1-7ced-4abb-865b-19eaa0b03363 tempest-TaggedBootDevicesTest-1869332682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-436eb599-1ca1-47da-bd86-04474ecc6900 req-68e9a0b1-7ced-4abb-865b-19eaa0b03363 tempest-TaggedBootDevicesTest-1869332682 None] attachment_update completed successfully.
Sep 10 19:24:08 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:24:09 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:24:13 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:24:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:24:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:24:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:24:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:24:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:24:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.199s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:13 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:24:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-7eb82da1-ec23-4620-b387-f5baf9280489 req-ce5e374e-22c4-42b1-b287-0f842e8d8a2f tempest-TaggedAttachmentsTest-1684326993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:24:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-7eb82da1-ec23-4620-b387-f5baf9280489 req-ce5e374e-22c4-42b1-b287-0f842e8d8a2f tempest-TaggedAttachmentsTest-1684326993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:24:28 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a87b52-1017-4ad4-9a17-578155049e25]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:24:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-7eb82da1-ec23-4620-b387-f5baf9280489 req-ce5e374e-22c4-42b1-b287-0f842e8d8a2f tempest-TaggedAttachmentsTest-1684326993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-7eb82da1-ec23-4620-b387-f5baf9280489 req-ce5e374e-22c4-42b1-b287-0f842e8d8a2f tempest-TaggedAttachmentsTest-1684326993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9" returned: 0 in 0.651s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-7eb82da1-ec23-4620-b387-f5baf9280489 req-ce5e374e-22c4-42b1-b287-0f842e8d8a2f tempest-TaggedAttachmentsTest-1684326993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.836s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:24:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-7eb82da1-ec23-4620-b387-f5baf9280489 req-ce5e374e-22c4-42b1-b287-0f842e8d8a2f tempest-TaggedAttachmentsTest-1684326993 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63e55b48-d7f8-44ca-a279-dda59c6e1efe', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:24:30 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-7eb82da1-ec23-4620-b387-f5baf9280489 req-ce5e374e-22c4-42b1-b287-0f842e8d8a2f tempest-TaggedAttachmentsTest-1684326993 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:24:30 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-7eb82da1-ec23-4620-b387-f5baf9280489 req-ce5e374e-22c4-42b1-b287-0f842e8d8a2f tempest-TaggedAttachmentsTest-1684326993 None] attachment_update completed successfully.
Sep 10 19:24:40 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:24:40 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:25:11 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-472bc41a-eecf-4122-b1ae-ba6bd14abcbf req-1ebb9f60-44ae-46c2-ae5f-3cf4adc654c6 tempest-TaggedAttachmentsTest-1684326993 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:25:12 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-472bc41a-eecf-4122-b1ae-ba6bd14abcbf req-1ebb9f60-44ae-46c2-ae5f-3cf4adc654c6 tempest-TaggedAttachmentsTest-1684326993 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:25:12 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-472bc41a-eecf-4122-b1ae-ba6bd14abcbf req-1ebb9f60-44ae-46c2-ae5f-3cf4adc654c6 tempest-TaggedAttachmentsTest-1684326993 None] Terminate volume connection completed successfully.
Sep 10 19:25:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-472bc41a-eecf-4122-b1ae-ba6bd14abcbf req-1ebb9f60-44ae-46c2-ae5f-3cf4adc654c6 tempest-TaggedAttachmentsTest-1684326993 None] Deleting attachment 63e55b48-d7f8-44ca-a279-dda59c6e1efe. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:25:13 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:25:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:25:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:25:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:25:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:25:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:25:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:25:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.658s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:25:13 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:25:22 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:25:22 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:25:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:25:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:26:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Acquiring lock "cinder-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Lock "cinder-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Acquiring lock "cinder-quobyte-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Lock "cinder-quobyte-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9" acquired by "delete_volume" :: waited 0.023s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:02 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[251d7baf-b83c-4acc-9bf5-8e245a1352e2]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9" returned: 0 in 0.673s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9" returned: 0 in 0.170s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Lock "cinder-quobyte-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9" released by "delete_volume" :: held 1.154s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:03 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Created reservations ['560ea860-2c9b-4865-84a9-584a496ad2f4', 'c0ed20df-ca74-4a3e-8a2f-19a9a4d6da5e', '7364dbb3-1b37-404c-b34e-4f1164890e84', 'e540a67a-5128-494c-a054-8e99713ae40f'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:26:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.124s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:04 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:26:04 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Deleted volume successfully.
Sep 10 19:26:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-98443d70-fc83-4720-a1a4-4bc6d2153642 tempest-TaggedAttachmentsTest-1684326993 None] Lock "cinder-9c11fafa-d4d0-4b2d-b02d-41ac923ed7e9-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:13 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:26:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.220s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:13 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:26:14 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=6,cinder:UPDATE=15 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:26:14 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=1,cinder:SELECT=4,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:26:21 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Flow 'volume_create_manager' (b6cce44d-fc7d-4297-bb93-d34aaca98dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f86c26f-1452-4ebe-becc-9d18bfb1ce27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f86c26f-1452-4ebe-becc-9d18bfb1ce27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-985939585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6361bb15-18b8-4e9c-ab62-76a14aacfe19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e41cd269a9444c69db58e830bf56ca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:26:21Z,use_quota=True,user_id='24926c90844a4da8a5295a9d3c646c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966d0958-1347-47a0-97c2-98f4da597059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966d0958-1347-47a0-97c2-98f4da597059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451677d2-521b-4214-bc83-06582041ba29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451677d2-521b-4214-bc83-06582041ba29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6361bb15-18b8-4e9c-ab62-76a14aacfe19', 'volume_name': 'volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d012c1-7b5f-4048-b5cd-e3f461e80a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d012c1-7b5f-4048-b5cd-e3f461e80a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24e186d-8eed-4eca-9be9-c206a2880570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:21 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Volume 6361bb15-18b8-4e9c-ab62-76a14aacfe19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19', 'volume_size': 1}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-985939585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6361bb15-18b8-4e9c-ab62-76a14aacfe19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e41cd269a9444c69db58e830bf56ca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:26:21Z,use_quota=True,user_id='24926c90844a4da8a5295a9d3c646c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Creating volume 6361bb15-18b8-4e9c-ab62-76a14aacfe19 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:26:21 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:26:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:22 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=12, name=volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:26:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19 1073741824" returned: 0 in 1.154s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19" returned: 0 in 0.227s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] <== create_volume: return (1611ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:26:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24e186d-8eed-4eca-9be9-c206a2880570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbe210b-869f-4d00-bd8d-dd4bbaf49575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:24 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Volume volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19 (6361bb15-18b8-4e9c-ab62-76a14aacfe19): created successfully
Sep 10 19:26:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbe210b-869f-4d00-bd8d-dd4bbaf49575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Flow 'volume_create_manager' (b6cce44d-fc7d-4297-bb93-d34aaca98dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:26:24 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d3fc53bc-5f72-4f65-8d2d-8d08e179475e tempest-AttachVolumeNegativeTest-1515327604 None] Created volume successfully.
Sep 10 19:26:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-18a78874-7c66-495a-bac3-42d4cf0419d3 req-aeb5e27b-e6c1-4ff9-aa4b-7bc7b484d6a1 tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-18a78874-7c66-495a-bac3-42d4cf0419d3 req-aeb5e27b-e6c1-4ff9-aa4b-7bc7b484d6a1 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:31 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ba21cd-2404-414b-90fa-b3e5f998fda5]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-18a78874-7c66-495a-bac3-42d4cf0419d3 req-aeb5e27b-e6c1-4ff9-aa4b-7bc7b484d6a1 tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-18a78874-7c66-495a-bac3-42d4cf0419d3 req-aeb5e27b-e6c1-4ff9-aa4b-7bc7b484d6a1 tempest-AttachVolumeNegativeTest-1515327604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19" returned: 0 in 0.793s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-18a78874-7c66-495a-bac3-42d4cf0419d3 req-aeb5e27b-e6c1-4ff9-aa4b-7bc7b484d6a1 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.901s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-18a78874-7c66-495a-bac3-42d4cf0419d3 req-aeb5e27b-e6c1-4ff9-aa4b-7bc7b484d6a1 tempest-AttachVolumeNegativeTest-1515327604 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '257351bf-183f-42d1-9ac3-dd60ed9b5109', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:26:32 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-18a78874-7c66-495a-bac3-42d4cf0419d3 req-aeb5e27b-e6c1-4ff9-aa4b-7bc7b484d6a1 tempest-AttachVolumeNegativeTest-1515327604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:32 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-18a78874-7c66-495a-bac3-42d4cf0419d3 req-aeb5e27b-e6c1-4ff9-aa4b-7bc7b484d6a1 tempest-AttachVolumeNegativeTest-1515327604 None] attachment_update completed successfully.
Sep 10 19:26:37 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c2109685-9db7-48ba-91c4-71feab2ac5c3 tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:37 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c2109685-9db7-48ba-91c4-71feab2ac5c3 tempest-GroupSnapshotsTest-341029746 None] Group tempest-GroupSnapshotsTest-Group-1533174776: creating
Sep 10 19:26:37 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c2109685-9db7-48ba-91c4-71feab2ac5c3 tempest-GroupSnapshotsTest-341029746 None] Group tempest-GroupSnapshotsTest-Group-1533174776: created successfully
Sep 10 19:26:37 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c2109685-9db7-48ba-91c4-71feab2ac5c3 tempest-GroupSnapshotsTest-341029746 None] Create group completed successfully.
Sep 10 19:26:38 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Flow 'volume_create_manager' (5e68e6f9-2fd1-45a5-9efa-07a92564965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d92afe9e-e72d-439e-8d95-c0beba9cdb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d92afe9e-e72d-439e-8d95-c0beba9cdb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-154365069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5651eaef-8180-4ec5-a7b5-a5b91b181c03,host='devstack@QuobyteHD#QuobyteHD',id=4fe9dba6-334e-4efd-92d7-009d85d0670c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930c86356f24c52b81266f6730981bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:26:39Z,use_quota=True,user_id='8258ebe4f38d4170964b6e878a135f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c43e458e-672e-4ce4-9f0d-969cc2ea23c4),volume_type_id=c43e458e-672e-4ce4-9f0d-969cc2ea23c4)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d13cbb7-f36f-4ebe-a228-baf16bdba574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d13cbb7-f36f-4ebe-a228-baf16bdba574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d98e56d-81e3-41a0-8d1b-953954dd2756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d98e56d-81e3-41a0-8d1b-953954dd2756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe9dba6-334e-4efd-92d7-009d85d0670c', 'volume_name': 'volume-4fe9dba6-334e-4efd-92d7-009d85d0670c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ad8036-c46b-4cdf-93a6-2e05614a0cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ad8036-c46b-4cdf-93a6-2e05614a0cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c9a6b6-9dfa-42e1-a70a-019f37c34e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:38 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Volume 4fe9dba6-334e-4efd-92d7-009d85d0670c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe9dba6-334e-4efd-92d7-009d85d0670c', 'volume_size': 1}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5651eaef-8180-4ec5-a7b5-a5b91b181c03,created_at=2025-09-10T17:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-154365069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5651eaef-8180-4ec5-a7b5-a5b91b181c03,host='devstack@QuobyteHD#QuobyteHD',id=4fe9dba6-334e-4efd-92d7-009d85d0670c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930c86356f24c52b81266f6730981bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:26:39Z,use_quota=True,user_id='8258ebe4f38d4170964b6e878a135f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c43e458e-672e-4ce4-9f0d-969cc2ea23c4),volume_type_id=c43e458e-672e-4ce4-9f0d-969cc2ea23c4)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Creating volume 4fe9dba6-334e-4efd-92d7-009d85d0670c {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:26:38 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:26:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:39 devstack quobyte-client[82855]: System call of process 87878 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:39 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=13, name=volume-4fe9dba6-334e-4efd-92d7-009d85d0670c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:26:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c 1073741824" returned: 0 in 0.439s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c" returned: 0 in 0.146s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] <== create_volume: return (649ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:26:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c9a6b6-9dfa-42e1-a70a-019f37c34e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe9dba6-334e-4efd-92d7-009d85d0670c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1725064-30b8-4982-bd60-f3266c5d720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:39 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Volume volume-4fe9dba6-334e-4efd-92d7-009d85d0670c (4fe9dba6-334e-4efd-92d7-009d85d0670c): created successfully
Sep 10 19:26:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1725064-30b8-4982-bd60-f3266c5d720b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Flow 'volume_create_manager' (5e68e6f9-2fd1-45a5-9efa-07a92564965a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:26:40 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b6026422-0abb-4e60-90f7-fb40242a87b2 tempest-GroupSnapshotsTest-341029746 None] Created volume successfully.
Sep 10 19:26:41 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] GroupSnapshot 807df6d6-45c1-4aa7-9ddb-e232d8696198: creating.
Sep 10 19:26:41 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] Group snapshot 807df6d6-45c1-4aa7-9ddb-e232d8696198: creating. {{(pid=82850) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 19:26:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] Creating offline snapshot af5e0761-f5f2-4d6c-aa90-9e1e39b642fc of volume 4fe9dba6-334e-4efd-92d7-009d85d0670c {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:26:42 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[591736f0-3a83-45ce-950b-085d8d2ec0d8]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c" returned: 0 in 0.569s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:42 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=14, name=volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:26:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc 1G" returned: 0 in 0.385s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4fe9dba6-334e-4efd-92d7-009d85d0670c -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img rebase -u -b volume-4fe9dba6-334e-4efd-92d7-009d85d0670c -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc" returned: 0 in 0.183s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:26:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc" returned: 0 in 0.125s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:26:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc" returned: 0 in 0.142s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.info" returned: 0 in 0.127s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:26:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.info" returned: 0 in 0.143s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b86f01ab-eddc-4b04-b76f-40a5cbc3f5cf tempest-GroupSnapshotsTest-341029746 None] group_snapshot 807df6d6-45c1-4aa7-9ddb-e232d8696198: created successfully
Sep 10 19:26:47 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "cinder-quobyte-af5e0761-f5f2-4d6c-aa90-9e1e39b642fc-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5" by "_create_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-af5e0761-f5f2-4d6c-aa90-9e1e39b642fc-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5" acquired by "_create_volume_from_snapshot" :: waited 0.113s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Creating volume 8e0c3a9d-0f7a-433d-84a1-8808b7131cc5 from snapshot af5e0761-f5f2-4d6c-aa90-9e1e39b642fc {{(pid=82850) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "cinder-quobyte-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] snapshot: af5e0761-f5f2-4d6c-aa90-9e1e39b642fc, volume: 8e0c3a9d-0f7a-433d-84a1-8808b7131cc5,  {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:48 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[096b5158-54c4-405b-8759-82ed01a00ea5]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:49 devstack quobyte-client[82855]: System call of process 87896 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc" returned: 0 in 1.243s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fe9dba6-334e-4efd-92d7-009d85d0670c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:26:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 19:26:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 19:26:49 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[723aa14d-cac4-4bd6-9d0d-17dc6c7c8104]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:50 devstack quobyte-client[82855]: System call of process 87903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c" returned: 0 in 1.157s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:50 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5 not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 19:26:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:50 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=16, name=volume-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:26:58 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:26:58 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:27:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5" returned: 0 in 17.021s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:07 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e90a649-0f82-4d64-a8d5-64df3a4556cd]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:09 devstack quobyte-client[82855]: System call of process 87969 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c" returned: 0 in 4.119s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:11 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Image conversion details: src /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c, size 1024.00 MB, duration 17.04 sec, destination /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:27:11 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Converted 1024.00 MB image at 60.11 MB/s
Sep 10 19:27:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:27:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5" returned: 0 in 0.388s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5" released by "_copy_volume_from_snapshot" :: held 24.541s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-af5e0761-f5f2-4d6c-aa90-9e1e39b642fc-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5" released by "_create_volume_from_snapshot" :: held 24.626s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 24.756s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:13 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:27:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.157s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 1.674s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:15 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:27:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e6388185-3a86-4b16-b103-e86dc4a14e55 tempest-GroupSnapshotsTest-341029746 None] Create group from source-snapshot-807df6d6-45c1-4aa7-9ddb-e232d8696198 completed successfully.
Sep 10 19:27:17 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "cinder-quobyte-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5" acquired by "delete_volume" :: waited 0.245s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:18 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[27555175-120b-4b9d-88d5-239e0d496e51]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:19 devstack quobyte-client[82855]: System call of process 88270 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5" returned: 0 in 1.355s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5" returned: 0 in 0.144s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-8e0c3a9d-0f7a-433d-84a1-8808b7131cc5" released by "delete_volume" :: held 2.116s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:20 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Created reservations ['b6f467ae-e897-4c42-a58d-6ab4bdd2f067'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:20 devstack cinder-volume[82850]: WARNING cinder.quota [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1781884534 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1781884534, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:27:20 devstack cinder-volume[82850]: WARNING cinder.quota [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1781884534 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1781884534, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:27:20 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Created reservations ['ae995278-e646-4442-a7c9-c856366d8859', 'a5c130fb-3e22-4f99-b78d-85f95861a47d', '78cfe1c8-8dac-4466-9ef3-4e6e6bfc2df4', '7bd33225-b463-4a4d-a4ae-c07cfd48a814'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.190s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:21 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:27:21 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2fe38fb0-87a8-4999-baf8-63e7d4175662 tempest-GroupSnapshotsTest-341029746 None] Delete group completed successfully.
Sep 10 19:27:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] group_snapshot 807df6d6-45c1-4aa7-9ddb-e232d8696198: deleting
Sep 10 19:27:22 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] group_snapshot 807df6d6-45c1-4aa7-9ddb-e232d8696198: deleting {{(pid=82850) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 19:27:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "cinder-quobyte-4fe9dba6-334e-4efd-92d7-009d85d0670c" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-4fe9dba6-334e-4efd-92d7-009d85d0670c" acquired by "delete_snapshot" :: waited 0.089s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "cinder-quobyte-af5e0761-f5f2-4d6c-aa90-9e1e39b642fc" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-af5e0761-f5f2-4d6c-aa90-9e1e39b642fc" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] Deleting offline snapshot af5e0761-f5f2-4d6c-aa90-9e1e39b642fc of volume 4fe9dba6-334e-4efd-92d7-009d85d0670c {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:27:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] snapshot_file for this snap is: volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:27:23 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[73004862-483b-4314-83a3-a0d5eeb73d46]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:23 devstack quobyte-client[82855]: System call of process 88304 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc" returned: 0 in 1.252s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fe9dba6-334e-4efd-92d7-009d85d0670c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:27:24 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2752d049-1a4d-46d9-86f5-585979893c71]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c" returned: 0 in 0.608s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc" returned: 0 in 0.385s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c.af5e0761-f5f2-4d6c-aa90-9e1e39b642fc" returned: 0 in 0.139s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-af5e0761-f5f2-4d6c-aa90-9e1e39b642fc" released by "_delete_snapshot" :: held 2.904s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-4fe9dba6-334e-4efd-92d7-009d85d0670c" released by "delete_snapshot" :: held 2.982s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:27 devstack cinder-volume[82850]: WARNING cinder.quota [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1781884534 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1781884534, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:27:27 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] Created reservations ['78a7a439-34e7-494c-86a9-3b25be77e3aa', '6ae5b234-d3a1-43fd-bce3-c41c211af868', '81ec1263-fd3b-4b1b-9813-9120661ec85a', 'e6e9615d-be02-449e-b3e8-875f6a2904f5'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:27 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-afada11d-cfcb-498a-8854-9141953c3ed4 tempest-GroupSnapshotsTest-341029746 None] group_snapshot 807df6d6-45c1-4aa7-9ddb-e232d8696198: deleted successfully
Sep 10 19:27:29 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "cinder-quobyte-4fe9dba6-334e-4efd-92d7-009d85d0670c" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-4fe9dba6-334e-4efd-92d7-009d85d0670c" acquired by "delete_volume" :: waited 0.038s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:29 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f4908d-dbdd-40e4-accd-aa5eb8328cf8]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:30 devstack quobyte-client[82855]: System call of process 88370 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c" returned: 0 in 1.329s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4fe9dba6-334e-4efd-92d7-009d85d0670c" returned: 0 in 0.202s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-4fe9dba6-334e-4efd-92d7-009d85d0670c" released by "delete_volume" :: held 1.915s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:32 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Created reservations ['281abe8c-1d26-41b7-ad9f-79642ec8c989'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:32 devstack cinder-volume[82850]: WARNING cinder.db.sqlalchemy.api [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1781884534']
Sep 10 19:27:32 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Created reservations ['802d6135-a34b-4cdb-be83-e1e4232f7227', '0fbbd1b5-24e6-4413-834a-22c30c67e438', '0459457d-5d98-440a-87e2-575d28617981', 'ad7ed24a-9cab-4db1-ad44-1c014a038ee6'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.154s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:33 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:27:33 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-63d3abe0-0579-48fb-b866-00ea14a83cdf tempest-GroupSnapshotsTest-341029746 None] Delete group completed successfully.
Sep 10 19:27:34 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-78b8c99b-0904-4f3e-8103-04d9b99d4fab req-11b77863-269e-42fa-8a27-857668bd890c tempest-TaggedBootDevicesTest-1869332682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:34 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-cc424a22-6d3b-4e55-94e9-4c6a0449dd34 tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cc424a22-6d3b-4e55-94e9-4c6a0449dd34 tempest-GroupSnapshotsTest-341029746 None] Group tempest-GroupSnapshotsTest-Group-1674808041: creating
Sep 10 19:27:34 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-78b8c99b-0904-4f3e-8103-04d9b99d4fab req-11b77863-269e-42fa-8a27-857668bd890c tempest-TaggedBootDevicesTest-1869332682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-78b8c99b-0904-4f3e-8103-04d9b99d4fab req-11b77863-269e-42fa-8a27-857668bd890c tempest-TaggedBootDevicesTest-1869332682 None] Terminate volume connection completed successfully.
Sep 10 19:27:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-78b8c99b-0904-4f3e-8103-04d9b99d4fab req-11b77863-269e-42fa-8a27-857668bd890c tempest-TaggedBootDevicesTest-1869332682 None] Deleting attachment 2e3e199b-dc1e-4843-ab6e-7ede54ae0999. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:27:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cc424a22-6d3b-4e55-94e9-4c6a0449dd34 tempest-GroupSnapshotsTest-341029746 None] Group tempest-GroupSnapshotsTest-Group-1674808041: created successfully
Sep 10 19:27:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cc424a22-6d3b-4e55-94e9-4c6a0449dd34 tempest-GroupSnapshotsTest-341029746 None] Create group completed successfully.
Sep 10 19:27:34 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-78b8c99b-0904-4f3e-8103-04d9b99d4fab req-49ba43ef-4902-4e86-a90f-0a55a692f42e tempest-TaggedBootDevicesTest-1869332682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:34 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-78b8c99b-0904-4f3e-8103-04d9b99d4fab req-49ba43ef-4902-4e86-a90f-0a55a692f42e tempest-TaggedBootDevicesTest-1869332682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-78b8c99b-0904-4f3e-8103-04d9b99d4fab req-49ba43ef-4902-4e86-a90f-0a55a692f42e tempest-TaggedBootDevicesTest-1869332682 None] Terminate volume connection completed successfully.
Sep 10 19:27:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-78b8c99b-0904-4f3e-8103-04d9b99d4fab req-49ba43ef-4902-4e86-a90f-0a55a692f42e tempest-TaggedBootDevicesTest-1869332682 None] Deleting attachment 3d8374b9-8e5e-48e8-b8e6-d360cc62cfdb. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:27:35 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-78b8c99b-0904-4f3e-8103-04d9b99d4fab req-1755ee58-7abb-4935-8a9c-a2e4a6195c5f tempest-TaggedBootDevicesTest-1869332682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:35 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-78b8c99b-0904-4f3e-8103-04d9b99d4fab req-1755ee58-7abb-4935-8a9c-a2e4a6195c5f tempest-TaggedBootDevicesTest-1869332682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:35 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-78b8c99b-0904-4f3e-8103-04d9b99d4fab req-1755ee58-7abb-4935-8a9c-a2e4a6195c5f tempest-TaggedBootDevicesTest-1869332682 None] Terminate volume connection completed successfully.
Sep 10 19:27:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-78b8c99b-0904-4f3e-8103-04d9b99d4fab req-1755ee58-7abb-4935-8a9c-a2e4a6195c5f tempest-TaggedBootDevicesTest-1869332682 None] Deleting attachment f8b78df3-c13b-4941-9e67-139b96f6a104. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:27:36 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Flow 'volume_create_manager' (3654b628-ebe4-48ae-a1d9-68a86b73ae8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6b779a-d9af-48ac-a493-297b9a62209e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6b779a-d9af-48ac-a493-297b9a62209e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1119873912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eceee9b6-dfd7-40a9-99ef-00c861c900b8,host='devstack@QuobyteHD#QuobyteHD',id=df321fca-8ce0-482e-ac3b-a76e10c0301d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930c86356f24c52b81266f6730981bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:27:37Z,use_quota=True,user_id='8258ebe4f38d4170964b6e878a135f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8001e4ad-f5de-44fc-a1e3-0b11f3900537),volume_type_id=8001e4ad-f5de-44fc-a1e3-0b11f3900537)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0822d33-6e60-4e3b-8e1d-d7dec5ba5707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0822d33-6e60-4e3b-8e1d-d7dec5ba5707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab03a06-bf9a-4bcc-b182-660b0e584b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab03a06-bf9a-4bcc-b182-660b0e584b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df321fca-8ce0-482e-ac3b-a76e10c0301d', 'volume_name': 'volume-df321fca-8ce0-482e-ac3b-a76e10c0301d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb95e5aa-5b8a-415b-afec-05c8381beab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb95e5aa-5b8a-415b-afec-05c8381beab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f02e530-762a-49eb-9732-d964a3b50299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:37 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Volume df321fca-8ce0-482e-ac3b-a76e10c0301d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df321fca-8ce0-482e-ac3b-a76e10c0301d', 'volume_size': 1}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=eceee9b6-dfd7-40a9-99ef-00c861c900b8,created_at=2025-09-10T17:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1119873912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eceee9b6-dfd7-40a9-99ef-00c861c900b8,host='devstack@QuobyteHD#QuobyteHD',id=df321fca-8ce0-482e-ac3b-a76e10c0301d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930c86356f24c52b81266f6730981bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:27:37Z,use_quota=True,user_id='8258ebe4f38d4170964b6e878a135f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8001e4ad-f5de-44fc-a1e3-0b11f3900537),volume_type_id=8001e4ad-f5de-44fc-a1e3-0b11f3900537)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Creating volume df321fca-8ce0-482e-ac3b-a76e10c0301d {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:27:37 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:27:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:37 devstack quobyte-client[82855]: System call of process 88411 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:37 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=17, name=volume-df321fca-8ce0-482e-ac3b-a76e10c0301d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:27:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d 1073741824" returned: 0 in 0.782s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d" returned: 0 in 0.285s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] <== create_volume: return (1273ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:27:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f02e530-762a-49eb-9732-d964a3b50299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df321fca-8ce0-482e-ac3b-a76e10c0301d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e8dafb-2aa2-4d20-9c7b-6c0bf32c7ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:39 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Volume volume-df321fca-8ce0-482e-ac3b-a76e10c0301d (df321fca-8ce0-482e-ac3b-a76e10c0301d): created successfully
Sep 10 19:27:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e8dafb-2aa2-4d20-9c7b-6c0bf32c7ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Flow 'volume_create_manager' (3654b628-ebe4-48ae-a1d9-68a86b73ae8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:27:39 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b1ddfbd8-1a65-4ed0-bb18-0345c6a2a85f tempest-GroupSnapshotsTest-341029746 None] Created volume successfully.
Sep 10 19:27:41 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Flow 'volume_create_manager' (0f991398-0e48-49d8-b533-4cbb553c6863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61beee80-0810-489d-aef7-3376f4f847e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61beee80-0810-489d-aef7-3376f4f847e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-853636103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eceee9b6-dfd7-40a9-99ef-00c861c900b8,host='devstack@QuobyteHD#QuobyteHD',id=9af03e2c-3419-4630-832c-23fbf8e9b592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930c86356f24c52b81266f6730981bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:27:41Z,use_quota=True,user_id='8258ebe4f38d4170964b6e878a135f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8001e4ad-f5de-44fc-a1e3-0b11f3900537),volume_type_id=8001e4ad-f5de-44fc-a1e3-0b11f3900537)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c060e5b-5e5e-49db-b2c6-ed788b37e388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c060e5b-5e5e-49db-b2c6-ed788b37e388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b666be20-ab0a-4508-96d5-98491a536403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b666be20-ab0a-4508-96d5-98491a536403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af03e2c-3419-4630-832c-23fbf8e9b592', 'volume_name': 'volume-9af03e2c-3419-4630-832c-23fbf8e9b592', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf65867-a780-4d4f-ac7c-d8199f0cb54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf65867-a780-4d4f-ac7c-d8199f0cb54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab47ccb8-4ecc-4937-a0da-857f129a2210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:41 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Volume 9af03e2c-3419-4630-832c-23fbf8e9b592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af03e2c-3419-4630-832c-23fbf8e9b592', 'volume_size': 1}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=eceee9b6-dfd7-40a9-99ef-00c861c900b8,created_at=2025-09-10T17:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-853636103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eceee9b6-dfd7-40a9-99ef-00c861c900b8,host='devstack@QuobyteHD#QuobyteHD',id=9af03e2c-3419-4630-832c-23fbf8e9b592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930c86356f24c52b81266f6730981bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:27:41Z,use_quota=True,user_id='8258ebe4f38d4170964b6e878a135f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8001e4ad-f5de-44fc-a1e3-0b11f3900537),volume_type_id=8001e4ad-f5de-44fc-a1e3-0b11f3900537)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Creating volume 9af03e2c-3419-4630-832c-23fbf8e9b592 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:27:41 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:27:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:42 devstack quobyte-client[82855]: System call of process 88419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:42 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=18, name=volume-9af03e2c-3419-4630-832c-23fbf8e9b592, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:27:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592 1073741824" returned: 0 in 0.681s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592" returned: 0 in 0.149s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] <== create_volume: return (940ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:27:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab47ccb8-4ecc-4937-a0da-857f129a2210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af03e2c-3419-4630-832c-23fbf8e9b592', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2dabe02-38be-41af-8ccf-29561d927665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:43 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Volume volume-9af03e2c-3419-4630-832c-23fbf8e9b592 (9af03e2c-3419-4630-832c-23fbf8e9b592): created successfully
Sep 10 19:27:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2dabe02-38be-41af-8ccf-29561d927665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Flow 'volume_create_manager' (0f991398-0e48-49d8-b533-4cbb553c6863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:27:43 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d8c36196-2cde-478f-9376-d407f14e86ce tempest-GroupSnapshotsTest-341029746 None] Created volume successfully.
Sep 10 19:27:44 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-e020717a-4860-45ac-9509-e053a68a6bb8 tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e020717a-4860-45ac-9509-e053a68a6bb8 tempest-GroupSnapshotsTest-341029746 None] Update group completed successfully.
Sep 10 19:27:45 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-2445d1d2-d3ed-4e84-93f2-6cdb85181a8f tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:45 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2445d1d2-d3ed-4e84-93f2-6cdb85181a8f tempest-GroupSnapshotsTest-341029746 None] Update group completed successfully.
Sep 10 19:27:46 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-cbdbd6b7-6d16-476b-b744-cdee92d53efc tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:47 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cbdbd6b7-6d16-476b-b744-cdee92d53efc tempest-GroupSnapshotsTest-341029746 None] Update group completed successfully.
Sep 10 19:27:48 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-e63c698a-5f15-4d43-809d-8123cb7922c1 tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:48 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e63c698a-5f15-4d43-809d-8123cb7922c1 tempest-GroupSnapshotsTest-341029746 None] Update group completed successfully.
Sep 10 19:27:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "cinder-da9fba1c-513e-46d5-a41d-d7d670c032c4-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Lock "cinder-da9fba1c-513e-46d5-a41d-d7d670c032c4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:48 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "cinder-quobyte-da9fba1c-513e-46d5-a41d-d7d670c032c4" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Lock "cinder-quobyte-da9fba1c-513e-46d5-a41d-d7d670c032c4" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:48 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1a7e49-695d-4f67-9e45-127ffdc76994]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-da9fba1c-513e-46d5-a41d-d7d670c032c4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-da9fba1c-513e-46d5-a41d-d7d670c032c4" returned: 0 in 0.519s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-da9fba1c-513e-46d5-a41d-d7d670c032c4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-da9fba1c-513e-46d5-a41d-d7d670c032c4" returned: 0 in 0.134s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Lock "cinder-quobyte-da9fba1c-513e-46d5-a41d-d7d670c032c4" released by "delete_volume" :: held 0.835s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Created reservations ['d43cf137-849b-47d7-b1a9-4f7a0a6cd384', '3e07d5f5-3cf2-4f89-ace9-24c7fa4d25a6', '585f7f04-bcf3-4e46-87b2-5a4ddd3bf166', '8edba238-fb66-4953-80a2-83247ed88c94'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:50 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] GroupSnapshot eb49be6d-5d5d-4ed9-afb7-3645c7442453: creating.
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.416s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:27:50 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Deleted volume successfully.
Sep 10 19:27:50 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Group snapshot eb49be6d-5d5d-4ed9-afb7-3645c7442453: creating. {{(pid=82850) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-77d81a18-cdf9-4998-b874-af11dd124510 tempest-TaggedBootDevicesTest-1869332682 None] Lock "cinder-da9fba1c-513e-46d5-a41d-d7d670c032c4-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Creating offline snapshot 38c299c3-a951-4525-ab28-12834928ad2b of volume df321fca-8ce0-482e-ac3b-a76e10c0301d {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4417858-8b8d-4d41-b097-05dcdf256c75]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "cinder-dfa99610-4702-4462-8df0-e1b81eb1463a-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Lock "cinder-dfa99610-4702-4462-8df0-e1b81eb1463a-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:51 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "cinder-quobyte-dfa99610-4702-4462-8df0-e1b81eb1463a" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Lock "cinder-quobyte-dfa99610-4702-4462-8df0-e1b81eb1463a" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:51 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfa3768-89e1-4c6b-92d3-95d7795dc784]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:51 devstack quobyte-client[82855]: System call of process 88433 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfa99610-4702-4462-8df0-e1b81eb1463a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d" returned: 0 in 0.966s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:52 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=19, name=volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:27:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b 1G" returned: 0 in 0.289s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img rebase -u -b volume-df321fca-8ce0-482e-ac3b-a76e10c0301d -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:52 devstack quobyte-client[82855]: System call of process 88440 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img rebase -u -b volume-df321fca-8ce0-482e-ac3b-a76e10c0301d -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b" returned: 0 in 0.156s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:27:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:52 devstack quobyte-client[82855]: System call of process 88436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b" returned: 0 in 0.121s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:27:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfa99610-4702-4462-8df0-e1b81eb1463a" returned: 0 in 1.009s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfa99610-4702-4462-8df0-e1b81eb1463a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b" returned: 0 in 0.216s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfa99610-4702-4462-8df0-e1b81eb1463a" returned: 0 in 0.190s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.info" returned: 0 in 0.171s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:27:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Lock "cinder-quobyte-dfa99610-4702-4462-8df0-e1b81eb1463a" released by "delete_volume" :: held 1.468s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.info" returned: 0 in 0.280s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Creating offline snapshot b91569cd-0ff2-4efc-931c-6aef8e932c6c of volume 9af03e2c-3419-4630-832c-23fbf8e9b592 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:27:53 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1543e0cd-4cb6-473a-8a1d-fd15b060dea6]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:54 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Created reservations ['ed1e19f8-fcab-4889-ac6a-a038bdce08df', 'd82c628a-e08f-4d1a-8cd7-506b57b83eee', '29adc5e2-3e6a-4a2c-8c6f-052122e538d7', '50061ff0-f9b3-4484-83b8-de608288e5cf'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.118s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:54 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:27:54 devstack quobyte-client[82855]: System call of process 88450 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Deleted volume successfully.
Sep 10 19:27:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592" returned: 0 in 0.953s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:54 devstack quobyte-client[82855]: System call of process 88454 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2ece5d1e-33d9-42ba-8a12-295964364048 tempest-TaggedBootDevicesTest-1869332682 None] Lock "cinder-dfa99610-4702-4462-8df0-e1b81eb1463a-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:54 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=21, name=volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:27:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c 1G" returned: 0 in 0.417s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9af03e2c-3419-4630-832c-23fbf8e9b592 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "cinder-5e30141d-c398-4eb8-9f97-820148e5b062-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img rebase -u -b volume-9af03e2c-3419-4630-832c-23fbf8e9b592 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c" returned: 0 in 0.283s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:27:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Lock "cinder-5e30141d-c398-4eb8-9f97-820148e5b062-delete_volume" acquired by "delete_volume" :: waited 0.181s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c" returned: 0 in 0.299s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:27:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:55 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "cinder-quobyte-5e30141d-c398-4eb8-9f97-820148e5b062" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c" returned: 0 in 0.403s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Lock "cinder-quobyte-5e30141d-c398-4eb8-9f97-820148e5b062" acquired by "delete_volume" :: waited 0.206s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.info" returned: 0 in 0.207s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:27:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:56 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae21030-92f4-4a59-a948-0a451f625ec2]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.info" returned: 0 in 0.213s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.026s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:56 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f87c0dec-b74d-46b7-8b85-a6e507406582 tempest-GroupSnapshotsTest-341029746 None] group_snapshot eb49be6d-5d5d-4ed9-afb7-3645c7442453: created successfully
Sep 10 19:27:57 devstack quobyte-client[82855]: System call of process 88465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062" returned: 0 in 0.754s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:57 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] group_snapshot eb49be6d-5d5d-4ed9-afb7-3645c7442453: deleting
Sep 10 19:27:58 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] group_snapshot eb49be6d-5d5d-4ed9-afb7-3645c7442453: deleting {{(pid=82850) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 19:27:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062" returned: 1 in 1.304s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:27:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "cinder-quobyte-df321fca-8ce0-482e-ac3b-a76e10c0301d" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5e30141d-c398-4eb8-9f97-820148e5b062" returned: 0 in 0.457s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-df321fca-8ce0-482e-ac3b-a76e10c0301d" acquired by "delete_snapshot" :: waited 0.092s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "cinder-quobyte-38c299c3-a951-4525-ab28-12834928ad2b" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Lock "cinder-quobyte-5e30141d-c398-4eb8-9f97-820148e5b062" released by "delete_volume" :: held 2.840s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-38c299c3-a951-4525-ab28-12834928ad2b" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Deleting offline snapshot 38c299c3-a951-4525-ab28-12834928ad2b of volume df321fca-8ce0-482e-ac3b-a76e10c0301d {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:27:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] snapshot_file for this snap is: volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:27:58 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b702ac-f3a2-4667-8d51-6a2c6842e87b]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:59 devstack quobyte-client[82855]: System call of process 88473 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:59 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Created reservations ['2b9bef94-4d14-4179-8037-056a469dd0d3', '11377e1c-cca2-4020-acc9-fb7daf587795', 'a90affdc-174f-4288-a93e-6b4e05d9f46b', '83a3a630-538a-4164-980a-29713a6569a3'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b" returned: 0 in 0.915s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df321fca-8ce0-482e-ac3b-a76e10c0301d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:28:00 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f38d38d-52b1-44d4-8d6f-a1292c1ea8aa]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:28:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:28:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.054s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:28:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:28:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:28:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:28:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:00 devstack quobyte-client[82855]: System call of process 88480 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:28:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.339s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d" returned: 0 in 1.182s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:01 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:28:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:01 devstack quobyte-client[82855]: System call of process 88487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:28:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Deleted volume successfully.
Sep 10 19:28:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a4170788-9010-483a-a806-31268525f07d tempest-TaggedBootDevicesTest-1869332682 None] Lock "cinder-5e30141d-c398-4eb8-9f97-820148e5b062-delete_volume" released by "delete_volume" :: held 6.915s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:28:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b" returned: 0 in 0.955s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d.38c299c3-a951-4525-ab28-12834928ad2b" returned: 0 in 0.192s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-38c299c3-a951-4525-ab28-12834928ad2b" released by "_delete_snapshot" :: held 3.821s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:28:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-df321fca-8ce0-482e-ac3b-a76e10c0301d" released by "delete_snapshot" :: held 3.951s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:28:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "cinder-quobyte-9af03e2c-3419-4630-832c-23fbf8e9b592" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:28:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-9af03e2c-3419-4630-832c-23fbf8e9b592" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:28:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "cinder-quobyte-b91569cd-0ff2-4efc-931c-6aef8e932c6c" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:28:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-b91569cd-0ff2-4efc-931c-6aef8e932c6c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:28:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Deleting offline snapshot b91569cd-0ff2-4efc-931c-6aef8e932c6c of volume 9af03e2c-3419-4630-832c-23fbf8e9b592 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:28:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] snapshot_file for this snap is: volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:28:03 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[299a80fb-05da-48e8-ae06-ac7fc379b5ea]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:28:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:04 devstack quobyte-client[82855]: System call of process 88497 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:28:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c" returned: 0 in 1.025s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af03e2c-3419-4630-832c-23fbf8e9b592(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:28:04 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bce92d3-b2ed-4386-8613-18c3cc21fde9]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:28:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:04 devstack quobyte-client[82855]: System call of process 88501 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:28:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592" returned: 0 in 0.641s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c" returned: 0 in 0.294s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592.b91569cd-0ff2-4efc-931c-6aef8e932c6c" returned: 0 in 0.148s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-b91569cd-0ff2-4efc-931c-6aef8e932c6c" released by "_delete_snapshot" :: held 2.600s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:28:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-9af03e2c-3419-4630-832c-23fbf8e9b592" released by "delete_snapshot" :: held 2.630s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:28:06 devstack cinder-volume[82850]: WARNING cinder.quota [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1936310264 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1936310264, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:28:06 devstack cinder-volume[82850]: WARNING cinder.quota [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1936310264 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1936310264, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:28:06 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Created reservations ['65611eca-089b-4016-a56a-f380f213baae', '9b29f337-afe0-45df-b4f8-3a823511b0a0', 'f53f8f00-b3ef-4373-b64c-c609a2e80a3c', 'ac739238-fc55-4a13-8d33-abe4697a0ff2'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:28:07 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] Created reservations ['04c2299e-90e5-40bd-85ac-a48c7aef69fc', '80fe1cd0-4ce9-46de-9c68-2e9997670398', 'ef690ba2-93b3-474e-96c1-f4d727e8a89a', '323acd20-8d6d-4a8b-8af8-6e59a0dbbc4e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:28:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3f779dab-e93c-432d-8c78-9a0528fbc57e tempest-GroupSnapshotsTest-341029746 None] group_snapshot eb49be6d-5d5d-4ed9-afb7-3645c7442453: deleted successfully
Sep 10 19:28:09 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:28:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "cinder-quobyte-9af03e2c-3419-4630-832c-23fbf8e9b592" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:28:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-9af03e2c-3419-4630-832c-23fbf8e9b592" acquired by "delete_volume" :: waited 0.030s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:28:09 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d6a444-f83a-4353-8eed-5ff57212744f]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:28:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592" returned: 0 in 0.581s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9af03e2c-3419-4630-832c-23fbf8e9b592" returned: 0 in 0.139s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-9af03e2c-3419-4630-832c-23fbf8e9b592" released by "delete_volume" :: held 0.942s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:28:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "cinder-quobyte-df321fca-8ce0-482e-ac3b-a76e10c0301d" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:28:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-df321fca-8ce0-482e-ac3b-a76e10c0301d" acquired by "delete_volume" :: waited 0.052s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:28:10 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[09299cd2-75a1-4f9a-be39-8bfcfabf4d17]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:28:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:10 devstack quobyte-client[82855]: System call of process 88547 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:28:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d" returned: 0 in 0.520s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-df321fca-8ce0-482e-ac3b-a76e10c0301d" returned: 0 in 0.153s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-df321fca-8ce0-482e-ac3b-a76e10c0301d" released by "delete_volume" :: held 0.895s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:28:11 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=76,cinder:SELECT=78,cinder:INSERT=16,cinder:DELETE=3 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:28:11 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=79,cinder:SELECT=77,cinder:INSERT=18,cinder:DELETE=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:28:12 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Created reservations ['16e92967-6874-41fc-ae17-ed376378435d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:28:12 devstack cinder-volume[82850]: WARNING cinder.quota [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1936310264 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1936310264, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:28:12 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Created reservations ['cc567db5-26bb-43a8-a65c-05f112d75677', 'bad2d958-4bca-474f-ae77-2fea9b033719', 'af3ce273-a69b-4de6-a0ac-0ca050b60bce', '9bd4d339-e4c7-48d2-a6a7-3332298edd9b'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:28:12 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Created reservations ['118061e2-b3ad-404d-969e-0fd99a24da67', '7ddd7648-5938-41dc-9c40-bb7993d3b857', '582a9067-9f8f-4f33-9036-83dc9387fedb', 'cfce908f-9e10-4911-9228-4dfebd48f9e7'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:28:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:28:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:28:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:28:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:28:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:28:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.174s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:13 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:28:13 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5d09976b-2e44-4100-af04-dc2da6ad6b0d tempest-GroupSnapshotsTest-341029746 None] Delete group completed successfully.
Sep 10 19:28:13 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:28:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:28:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:28:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:28:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:28:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:28:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.282s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:13 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:28:14 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-dc877a1d-c9ab-4ba1-a36c-650dc7a19581 tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:28:14 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-dc877a1d-c9ab-4ba1-a36c-650dc7a19581 tempest-GroupSnapshotsTest-341029746 None] Group tempest-GroupSnapshotsTest-Group-1559649211: creating
Sep 10 19:28:14 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-dc877a1d-c9ab-4ba1-a36c-650dc7a19581 tempest-GroupSnapshotsTest-341029746 None] Group tempest-GroupSnapshotsTest-Group-1559649211: created successfully
Sep 10 19:28:14 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-dc877a1d-c9ab-4ba1-a36c-650dc7a19581 tempest-GroupSnapshotsTest-341029746 None] Create group completed successfully.
Sep 10 19:28:16 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Flow 'volume_create_manager' (8c22f52e-40d4-4a16-8dce-cb250ea74515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a325945b-5fe6-4a52-9986-90a845928f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a325945b-5fe6-4a52-9986-90a845928f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-138426874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c5d30126-07fb-4e4b-ad38-009b89c19fdf,host='devstack@QuobyteHD#QuobyteHD',id=b2e4b263-e933-4897-ba01-ec25f5a1a273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930c86356f24c52b81266f6730981bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:28:16Z,use_quota=True,user_id='8258ebe4f38d4170964b6e878a135f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4ea0c1f-3353-4860-91aa-d81c756e550e),volume_type_id=e4ea0c1f-3353-4860-91aa-d81c756e550e)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2a3293-5206-41e4-9f1b-1509ccef167a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2a3293-5206-41e4-9f1b-1509ccef167a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389dca7c-6018-4dbe-a5ad-3fff4951f34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389dca7c-6018-4dbe-a5ad-3fff4951f34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2e4b263-e933-4897-ba01-ec25f5a1a273', 'volume_name': 'volume-b2e4b263-e933-4897-ba01-ec25f5a1a273', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21f15d0-ac5f-41e7-aa3f-14ad1af12fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21f15d0-ac5f-41e7-aa3f-14ad1af12fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b91f29-7df5-415c-a036-74b20497efda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Volume b2e4b263-e933-4897-ba01-ec25f5a1a273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2e4b263-e933-4897-ba01-ec25f5a1a273', 'volume_size': 1}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c5d30126-07fb-4e4b-ad38-009b89c19fdf,created_at=2025-09-10T17:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-138426874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c5d30126-07fb-4e4b-ad38-009b89c19fdf,host='devstack@QuobyteHD#QuobyteHD',id=b2e4b263-e933-4897-ba01-ec25f5a1a273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930c86356f24c52b81266f6730981bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:28:16Z,use_quota=True,user_id='8258ebe4f38d4170964b6e878a135f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4ea0c1f-3353-4860-91aa-d81c756e550e),volume_type_id=e4ea0c1f-3353-4860-91aa-d81c756e550e)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Creating volume b2e4b263-e933-4897-ba01-ec25f5a1a273 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:28:16 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:16 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=23, name=volume-b2e4b263-e933-4897-ba01-ec25f5a1a273, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273 1073741824" returned: 0 in 0.544s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273" returned: 0 in 0.188s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] <== create_volume: return (809ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:28:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:28:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b91f29-7df5-415c-a036-74b20497efda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2e4b263-e933-4897-ba01-ec25f5a1a273', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d876b4b-1102-4e3a-9989-c62f642ebaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:17 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Volume volume-b2e4b263-e933-4897-ba01-ec25f5a1a273 (b2e4b263-e933-4897-ba01-ec25f5a1a273): created successfully
Sep 10 19:28:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d876b4b-1102-4e3a-9989-c62f642ebaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Flow 'volume_create_manager' (8c22f52e-40d4-4a16-8dce-cb250ea74515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:28:17 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ba4234c0-91ff-4a9f-96a7-98467ed23ac0 tempest-GroupSnapshotsTest-341029746 None] Created volume successfully.
Sep 10 19:28:19 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] GroupSnapshot 3ca28b69-61dc-4f81-a1bb-93553a82b36c: creating.
Sep 10 19:28:19 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:28:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] Group snapshot 3ca28b69-61dc-4f81-a1bb-93553a82b36c: creating. {{(pid=82850) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 19:28:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:28:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:28:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] Creating offline snapshot be572789-3e0d-40c5-be80-93999b4c739b of volume b2e4b263-e933-4897-ba01-ec25f5a1a273 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:28:19 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4a4d0d-e4d4-46ee-8c46-4dbcc9b4b534]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:28:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273" returned: 0 in 0.617s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:20 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=24, name=volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:28:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b 1G" returned: 0 in 0.387s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b2e4b263-e933-4897-ba01-ec25f5a1a273 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img rebase -u -b volume-b2e4b263-e933-4897-ba01-ec25f5a1a273 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b" returned: 0 in 0.279s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:28:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b" returned: 0 in 0.148s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:28:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b" returned: 0 in 0.115s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.info" returned: 0 in 0.158s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:28:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.info" returned: 0 in 0.134s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.345s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:28:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cd76ed61-b04c-48c9-80cd-ac8e792f408a tempest-GroupSnapshotsTest-341029746 None] group_snapshot 3ca28b69-61dc-4f81-a1bb-93553a82b36c: created successfully
Sep 10 19:28:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] group_snapshot 3ca28b69-61dc-4f81-a1bb-93553a82b36c: deleting
Sep 10 19:28:23 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:28:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] group_snapshot 3ca28b69-61dc-4f81-a1bb-93553a82b36c: deleting {{(pid=82850) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 19:28:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "cinder-quobyte-b2e4b263-e933-4897-ba01-ec25f5a1a273" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:28:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-b2e4b263-e933-4897-ba01-ec25f5a1a273" acquired by "delete_snapshot" :: waited 0.071s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:28:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "cinder-quobyte-be572789-3e0d-40c5-be80-93999b4c739b" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:28:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-be572789-3e0d-40c5-be80-93999b4c739b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:28:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Deleting offline snapshot be572789-3e0d-40c5-be80-93999b4c739b of volume b2e4b263-e933-4897-ba01-ec25f5a1a273 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:28:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] snapshot_file for this snap is: volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:28:23 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[53948f79-ff02-41f9-a2ad-e527bb02af4c]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:28:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:23 devstack quobyte-client[82855]: System call of process 88581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:28:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b" returned: 0 in 0.549s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2e4b263-e933-4897-ba01-ec25f5a1a273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:28:24 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecf5e16-5c76-45d7-8ea7-6bb52e4c556b]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:28:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:24 devstack quobyte-client[82855]: System call of process 88584 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:28:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273" returned: 0 in 0.525s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b" returned: 0 in 0.286s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273.be572789-3e0d-40c5-be80-93999b4c739b" returned: 0 in 0.096s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-be572789-3e0d-40c5-be80-93999b4c739b" released by "_delete_snapshot" :: held 1.759s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:28:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-b2e4b263-e933-4897-ba01-ec25f5a1a273" released by "delete_snapshot" :: held 1.802s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:28:26 devstack cinder-volume[82850]: WARNING cinder.quota [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-534878586 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-534878586, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:28:26 devstack cinder-volume[82850]: WARNING cinder.quota [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-534878586 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-534878586, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:28:26 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] Created reservations ['1cf3cd93-365c-46ac-a2c9-eaf2e0ce7598', '6d4149a7-5d3c-4a9d-8740-e6d8bfe1d006', '56d851dc-c34d-4081-b898-821a64650433', '422d6b7b-3b55-459d-9a89-4c6ffad312fb'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:28:26 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3ebe5bcc-0464-48fb-9db7-2602d0ae9d6b tempest-GroupSnapshotsTest-341029746 None] group_snapshot 3ca28b69-61dc-4f81-a1bb-93553a82b36c: deleted successfully
Sep 10 19:28:27 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:28:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "cinder-quobyte-b2e4b263-e933-4897-ba01-ec25f5a1a273" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:28:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-b2e4b263-e933-4897-ba01-ec25f5a1a273" acquired by "delete_volume" :: waited 0.058s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:28:27 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d701b8d-3d22-4fa8-bc90-52762b09eb25]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:28:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273" returned: 0 in 0.572s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b2e4b263-e933-4897-ba01-ec25f5a1a273" returned: 0 in 0.123s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Lock "cinder-quobyte-b2e4b263-e933-4897-ba01-ec25f5a1a273" released by "delete_volume" :: held 0.892s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:28:28 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Created reservations ['94f5f842-8afd-43ab-a493-d9c561ea64a0'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:28:28 devstack cinder-volume[82850]: WARNING cinder.quota [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-534878586 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-534878586, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:28:28 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Created reservations ['09ad83e7-8867-41e6-a48e-ef23066c3f99', '04fcd21d-ce30-4bbd-9f59-22a5d2842791', 'b0aca7db-bd9a-4c5a-b75b-486d760cf119', '39f01d9b-f4b0-4c30-85d5-86d55ed160f6'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:28:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:28:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:28:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:28:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:28:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:28:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.139s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:29 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:28:29 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-44464749-b640-4933-9d67-7f9b253ce9b1 tempest-GroupSnapshotsTest-341029746 None] Delete group completed successfully.
Sep 10 19:28:38 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=34,cinder:INSERT=13,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:28:39 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=37,cinder:UPDATE=44,cinder:INSERT=5 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:28:39 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-1909ab02-58ef-4048-86fb-c81a25a7bdd2 tempest-GroupSnapshotsV319Test-1059798989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:28:39 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1909ab02-58ef-4048-86fb-c81a25a7bdd2 tempest-GroupSnapshotsV319Test-1059798989 None] Group tempest-GroupSnapshotsV319Test-Group-1893988332: creating
Sep 10 19:28:39 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1909ab02-58ef-4048-86fb-c81a25a7bdd2 tempest-GroupSnapshotsV319Test-1059798989 None] Group tempest-GroupSnapshotsV319Test-Group-1893988332: created successfully
Sep 10 19:28:39 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1909ab02-58ef-4048-86fb-c81a25a7bdd2 tempest-GroupSnapshotsV319Test-1059798989 None] Create group completed successfully.
Sep 10 19:28:41 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Flow 'volume_create_manager' (d0055627-4b41-4964-9515-2efd8fef7ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a88285f-5a14-4322-a2fa-748b8cc8241f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a88285f-5a14-4322-a2fa-748b8cc8241f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1435773043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d8bdff92-cfef-407a-8615-926ef235491b,host='devstack@QuobyteHD#QuobyteHD',id=830e260f-22c5-430f-a0f5-46821100d703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b4c459a95b4b0c82aa0e68fa52b9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:28:41Z,use_quota=True,user_id='8ba1054381af4fbfacce5ec7391b9f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b68a9ca-8eeb-4890-89d8-3b4d76e8f469),volume_type_id=8b68a9ca-8eeb-4890-89d8-3b4d76e8f469)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e1aec6-9b4d-4f0f-9482-b8a6422c97e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e1aec6-9b4d-4f0f-9482-b8a6422c97e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efeee4b9-a57a-4428-a7fc-fe3f93dd0c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efeee4b9-a57a-4428-a7fc-fe3f93dd0c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '830e260f-22c5-430f-a0f5-46821100d703', 'volume_name': 'volume-830e260f-22c5-430f-a0f5-46821100d703', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3303898-ed70-4078-8ac8-b810eb784b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3303898-ed70-4078-8ac8-b810eb784b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27aae849-feda-4dda-b31a-8fdea15ae077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:41 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Volume 830e260f-22c5-430f-a0f5-46821100d703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-830e260f-22c5-430f-a0f5-46821100d703', 'volume_size': 1}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d8bdff92-cfef-407a-8615-926ef235491b,created_at=2025-09-10T17:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1435773043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d8bdff92-cfef-407a-8615-926ef235491b,host='devstack@QuobyteHD#QuobyteHD',id=830e260f-22c5-430f-a0f5-46821100d703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b4c459a95b4b0c82aa0e68fa52b9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:28:41Z,use_quota=True,user_id='8ba1054381af4fbfacce5ec7391b9f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b68a9ca-8eeb-4890-89d8-3b4d76e8f469),volume_type_id=8b68a9ca-8eeb-4890-89d8-3b4d76e8f469)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Creating volume 830e260f-22c5-430f-a0f5-46821100d703 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:28:41 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:28:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:42 devstack quobyte-client[82855]: System call of process 88646 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:28:42 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=26, name=volume-830e260f-22c5-430f-a0f5-46821100d703, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:28:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703 1073741824" returned: 0 in 0.909s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703" returned: 0 in 0.212s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] <== create_volume: return (1373ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:28:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:28:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27aae849-feda-4dda-b31a-8fdea15ae077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-830e260f-22c5-430f-a0f5-46821100d703', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bc69a8-65ef-4970-94b0-1d05e3d4b25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:43 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Volume volume-830e260f-22c5-430f-a0f5-46821100d703 (830e260f-22c5-430f-a0f5-46821100d703): created successfully
Sep 10 19:28:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bc69a8-65ef-4970-94b0-1d05e3d4b25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Flow 'volume_create_manager' (d0055627-4b41-4964-9515-2efd8fef7ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:28:43 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4df794ed-1b60-4b0b-bbdc-e0462ac80f26 tempest-GroupSnapshotsV319Test-1059798989 None] Created volume successfully.
Sep 10 19:28:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] GroupSnapshot 3883e606-74ee-437e-92a8-0bb9e8955c1a: creating.
Sep 10 19:28:45 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:28:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] Group snapshot 3883e606-74ee-437e-92a8-0bb9e8955c1a: creating. {{(pid=82850) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 19:28:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:28:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:28:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] Creating offline snapshot a76bc4b3-2750-435b-9a69-5889658fad89 of volume 830e260f-22c5-430f-a0f5-46821100d703 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:28:45 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d521fc26-111e-472d-9ceb-ca9495a25e0c]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:28:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703" returned: 0 in 1.004s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:46 devstack quobyte-client[82855]: System call of process 88665 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:28:47 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=27, name=volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:28:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89 1G" returned: 0 in 0.908s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): qemu-img rebase -u -b volume-830e260f-22c5-430f-a0f5-46821100d703 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:47 devstack quobyte-client[82855]: System call of process 88687 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:28:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] CMD "qemu-img rebase -u -b volume-830e260f-22c5-430f-a0f5-46821100d703 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89" returned: 0 in 0.236s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:28:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89" returned: 0 in 0.256s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:28:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89" returned: 0 in 0.173s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.info" returned: 0 in 0.189s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:28:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.info" returned: 0 in 0.128s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.749s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:28:49 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-28c79d09-c784-4bdc-89b8-c7f4073fd283 tempest-GroupSnapshotsV319Test-1059798989 None] group_snapshot 3883e606-74ee-437e-92a8-0bb9e8955c1a: created successfully
Sep 10 19:28:51 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] group_snapshot 3883e606-74ee-437e-92a8-0bb9e8955c1a: deleting
Sep 10 19:28:51 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:28:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] group_snapshot 3883e606-74ee-437e-92a8-0bb9e8955c1a: deleting {{(pid=82850) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 19:28:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Acquiring lock "cinder-quobyte-830e260f-22c5-430f-a0f5-46821100d703" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:28:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Lock "cinder-quobyte-830e260f-22c5-430f-a0f5-46821100d703" acquired by "delete_snapshot" :: waited 0.084s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:28:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Acquiring lock "cinder-quobyte-a76bc4b3-2750-435b-9a69-5889658fad89" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:28:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Lock "cinder-quobyte-a76bc4b3-2750-435b-9a69-5889658fad89" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:28:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Deleting offline snapshot a76bc4b3-2750-435b-9a69-5889658fad89 of volume 830e260f-22c5-430f-a0f5-46821100d703 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:28:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] snapshot_file for this snap is: volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:28:51 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[07852520-a696-4a1e-bcc8-0f113093378b]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:28:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89" returned: 0 in 0.501s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-830e260f-22c5-430f-a0f5-46821100d703(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:28:51 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[800de1df-3ee7-4d12-b373-b7d3fbd850fc]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:28:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703" returned: 0 in 0.550s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:52 devstack quobyte-client[82855]: System call of process 88707 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:28:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89" returned: 0 in 0.254s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703.a76bc4b3-2750-435b-9a69-5889658fad89" returned: 0 in 0.126s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Lock "cinder-quobyte-a76bc4b3-2750-435b-9a69-5889658fad89" released by "_delete_snapshot" :: held 1.785s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:28:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Lock "cinder-quobyte-830e260f-22c5-430f-a0f5-46821100d703" released by "delete_snapshot" :: held 1.828s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:28:53 devstack cinder-volume[82850]: WARNING cinder.quota [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-464837236 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-464837236, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:28:53 devstack cinder-volume[82850]: WARNING cinder.quota [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-464837236 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-464837236, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:28:53 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] Created reservations ['286a68a7-f0f6-4085-9067-bb9c34c550b2', '23a6f334-14f4-43ca-afe1-e6215689d2e3', '6751bd73-3258-4d19-9f51-682e41cb4266', '2c1847e9-dc11-43b7-b23f-59b7fb2f49af'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:28:53 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8d5b85c7-25b5-4892-8ea4-833e4f57f549 tempest-GroupSnapshotsV319Test-1059798989 None] group_snapshot 3883e606-74ee-437e-92a8-0bb9e8955c1a: deleted successfully
Sep 10 19:28:54 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:28:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Acquiring lock "cinder-quobyte-830e260f-22c5-430f-a0f5-46821100d703" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:28:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Lock "cinder-quobyte-830e260f-22c5-430f-a0f5-46821100d703" acquired by "delete_volume" :: waited 0.023s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:28:54 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bf2516-ebda-48c7-a526-1bfccef7e042]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:28:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703" returned: 0 in 0.547s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-830e260f-22c5-430f-a0f5-46821100d703" returned: 0 in 0.122s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Lock "cinder-quobyte-830e260f-22c5-430f-a0f5-46821100d703" released by "delete_volume" :: held 0.864s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:28:56 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Created reservations ['b26d4065-a2fb-4e49-ba34-0f8123c1d436'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:28:56 devstack cinder-volume[82850]: WARNING cinder.quota [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-464837236 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-464837236, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:28:56 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Created reservations ['dfff051a-fd5d-4507-a1d2-254a4b53cff8', '296b03b2-3e65-4ada-9eda-eb72e236ae83', '027c708e-fae2-46ea-895b-1b53f71a87ec', 'c5960efe-dc24-4c13-9d59-88b458d02b55'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:28:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:28:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:28:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:28:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:28:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:28:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.129s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:57 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:28:57 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-bcd198e2-6e89-4c64-a687-f406022ac3bf tempest-GroupSnapshotsV319Test-1059798989 None] Delete group completed successfully.
Sep 10 19:29:06 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=16,cinder:SELECT=20,cinder:INSERT=6 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:29:06 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=27,cinder:UPDATE=27,cinder:DELETE=1,cinder:INSERT=3 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:29:13 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:29:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:29:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:29:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:29:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:29:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:29:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.451s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:29:17 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-8089751c-ee9c-45a0-8e2a-8bfc2258d9ea tempest-GroupsTest-1757050789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:29:17 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8089751c-ee9c-45a0-8e2a-8bfc2258d9ea tempest-GroupsTest-1757050789 None] Group tempest-Group1-1959172945: creating
Sep 10 19:29:17 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8089751c-ee9c-45a0-8e2a-8bfc2258d9ea tempest-GroupsTest-1757050789 None] Group tempest-Group1-1959172945: created successfully
Sep 10 19:29:17 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8089751c-ee9c-45a0-8e2a-8bfc2258d9ea tempest-GroupsTest-1757050789 None] Create group completed successfully.
Sep 10 19:29:18 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-6ad31438-f100-4d57-9077-d9a92c204bda tempest-GroupsTest-1757050789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:29:18 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6ad31438-f100-4d57-9077-d9a92c204bda tempest-GroupsTest-1757050789 None] Group tempest-Group2-364583115: creating
Sep 10 19:29:18 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6ad31438-f100-4d57-9077-d9a92c204bda tempest-GroupsTest-1757050789 None] Group tempest-Group2-364583115: created successfully
Sep 10 19:29:18 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6ad31438-f100-4d57-9077-d9a92c204bda tempest-GroupsTest-1757050789 None] Create group completed successfully.
Sep 10 19:29:20 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Flow 'volume_create_manager' (883e7655-f481-4af0-a3f7-84b132a131a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc380cbc-a4ea-4df7-89ff-9f861c5718f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc380cbc-a4ea-4df7-89ff-9f861c5718f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-639233479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=64efbdb1-3d18-4290-beb5-6cda11a97d79,host='devstack@QuobyteHD#QuobyteHD',id=a5549cb6-0b76-439d-84ed-0e1632f1ffde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e530ecb742e444b8390db36047c14ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:29:20Z,use_quota=True,user_id='3f59321fe3324f9da79f5f227b85ae83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2bfe17f-1b84-4e4f-b8d7-a84045b3d02e),volume_type_id=a2bfe17f-1b84-4e4f-b8d7-a84045b3d02e)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d3626c-3374-40ae-856f-939ef3e5d6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d3626c-3374-40ae-856f-939ef3e5d6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a821af-17ae-461b-9d93-6cf0b3a99559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a821af-17ae-461b-9d93-6cf0b3a99559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5549cb6-0b76-439d-84ed-0e1632f1ffde', 'volume_name': 'volume-a5549cb6-0b76-439d-84ed-0e1632f1ffde', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf22340-d87c-4e40-aa1e-d5e2d3d4b979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf22340-d87c-4e40-aa1e-d5e2d3d4b979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdebd34-0dc8-4c0b-85ab-bfe8db8ec223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:20 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Volume a5549cb6-0b76-439d-84ed-0e1632f1ffde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5549cb6-0b76-439d-84ed-0e1632f1ffde', 'volume_size': 1}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=64efbdb1-3d18-4290-beb5-6cda11a97d79,created_at=2025-09-10T17:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-639233479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=64efbdb1-3d18-4290-beb5-6cda11a97d79,host='devstack@QuobyteHD#QuobyteHD',id=a5549cb6-0b76-439d-84ed-0e1632f1ffde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e530ecb742e444b8390db36047c14ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:29:20Z,use_quota=True,user_id='3f59321fe3324f9da79f5f227b85ae83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2bfe17f-1b84-4e4f-b8d7-a84045b3d02e),volume_type_id=a2bfe17f-1b84-4e4f-b8d7-a84045b3d02e)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Creating volume a5549cb6-0b76-439d-84ed-0e1632f1ffde {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:29:20 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:29:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a5549cb6-0b76-439d-84ed-0e1632f1ffde 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:20 devstack quobyte-client[82855]: System call of process 88839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:29:20 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=29, name=volume-a5549cb6-0b76-439d-84ed-0e1632f1ffde, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:29:20 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-5358335f-3cbd-46c1-ac44-64ba35a37151 req-647d1c08-5884-4f19-86cf-f2649de678f5 tempest-AttachVolumeNegativeTest-1515327604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:29:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a5549cb6-0b76-439d-84ed-0e1632f1ffde 1073741824" returned: 0 in 0.842s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a5549cb6-0b76-439d-84ed-0e1632f1ffde {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:21 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-5358335f-3cbd-46c1-ac44-64ba35a37151 req-647d1c08-5884-4f19-86cf-f2649de678f5 tempest-AttachVolumeNegativeTest-1515327604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:29:21 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-5358335f-3cbd-46c1-ac44-64ba35a37151 req-647d1c08-5884-4f19-86cf-f2649de678f5 tempest-AttachVolumeNegativeTest-1515327604 None] Terminate volume connection completed successfully.
Sep 10 19:29:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5358335f-3cbd-46c1-ac44-64ba35a37151 req-647d1c08-5884-4f19-86cf-f2649de678f5 tempest-AttachVolumeNegativeTest-1515327604 None] Deleting attachment 257351bf-183f-42d1-9ac3-dd60ed9b5109. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:29:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a5549cb6-0b76-439d-84ed-0e1632f1ffde" returned: 0 in 0.349s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] <== create_volume: return (1210ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:29:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:29:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdebd34-0dc8-4c0b-85ab-bfe8db8ec223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5549cb6-0b76-439d-84ed-0e1632f1ffde', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f8f392-5b61-4696-8711-363fae598526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:21 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Volume volume-a5549cb6-0b76-439d-84ed-0e1632f1ffde (a5549cb6-0b76-439d-84ed-0e1632f1ffde): created successfully
Sep 10 19:29:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f8f392-5b61-4696-8711-363fae598526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Flow 'volume_create_manager' (883e7655-f481-4af0-a3f7-84b132a131a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:29:21 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c579f45f-43e7-4d04-9afc-39ea2d4583f9 tempest-GroupsTest-1757050789 None] Created volume successfully.
Sep 10 19:29:24 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:29:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Acquiring lock "cinder-quobyte-a5549cb6-0b76-439d-84ed-0e1632f1ffde" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:29:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Lock "cinder-quobyte-a5549cb6-0b76-439d-84ed-0e1632f1ffde" acquired by "delete_volume" :: waited 0.114s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:29:24 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[721649eb-1c86-43ec-a4a2-e29d30799677]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:29:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a5549cb6-0b76-439d-84ed-0e1632f1ffde {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:26 devstack quobyte-client[82855]: System call of process 88846 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:29:26 devstack quobyte-client[82855]: System call of process 88846 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:29:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a5549cb6-0b76-439d-84ed-0e1632f1ffde" returned: 0 in 2.439s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a5549cb6-0b76-439d-84ed-0e1632f1ffde {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a5549cb6-0b76-439d-84ed-0e1632f1ffde" returned: 0 in 0.489s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Lock "cinder-quobyte-a5549cb6-0b76-439d-84ed-0e1632f1ffde" released by "delete_volume" :: held 3.403s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:29:28 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Created reservations ['96fba32b-21ff-4ac3-b727-5c3c8be90078'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:29:28 devstack cinder-volume[82850]: WARNING cinder.quota [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-407599776 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-407599776, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:29:28 devstack cinder-volume[82850]: WARNING cinder.quota [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-407599776 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-407599776, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:29:28 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Created reservations ['dbe9a3fd-330a-48ac-999a-cec9962d4c90', '4f48380b-d203-4262-90c8-b3c9150deb85', '5556553a-91ba-45c5-8ae2-bd3486f2e1a8', 'e23767c4-1b4d-48fb-b146-6a9f827d45b9'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:29:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:29:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:29:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:29:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:29:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:29:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.178s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:29 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:29:29 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-484589b1-a4bc-4768-8a88-b8b0da2fb471 tempest-GroupsTest-1757050789 None] Delete group completed successfully.
Sep 10 19:29:30 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-4461f109-4c0b-4d8b-9c71-d703ce87efb2 tempest-GroupsTest-1757050789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:29:31 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-4461f109-4c0b-4d8b-9c71-d703ce87efb2 tempest-GroupsTest-1757050789 None] Created reservations ['5125a5a7-2570-4e13-9f7b-b4d4cdbe9610'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:29:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4461f109-4c0b-4d8b-9c71-d703ce87efb2 tempest-GroupsTest-1757050789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:29:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4461f109-4c0b-4d8b-9c71-d703ce87efb2 tempest-GroupsTest-1757050789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:29:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4461f109-4c0b-4d8b-9c71-d703ce87efb2 tempest-GroupsTest-1757050789 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:29:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4461f109-4c0b-4d8b-9c71-d703ce87efb2 tempest-GroupsTest-1757050789 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:29:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4461f109-4c0b-4d8b-9c71-d703ce87efb2 tempest-GroupsTest-1757050789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:29:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4461f109-4c0b-4d8b-9c71-d703ce87efb2 tempest-GroupsTest-1757050789 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4461f109-4c0b-4d8b-9c71-d703ce87efb2 tempest-GroupsTest-1757050789 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.285s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:31 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-4461f109-4c0b-4d8b-9c71-d703ce87efb2 tempest-GroupsTest-1757050789 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:29:31 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4461f109-4c0b-4d8b-9c71-d703ce87efb2 tempest-GroupsTest-1757050789 None] Delete group completed successfully.
Sep 10 19:29:33 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-dd03a758-b302-442f-8b43-659f8a9014f5 tempest-GroupsTest-1757050789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:29:33 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-dd03a758-b302-442f-8b43-659f8a9014f5 tempest-GroupsTest-1757050789 None] Group tempest-GroupsTest-Group-444251941: creating
Sep 10 19:29:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-dd03a758-b302-442f-8b43-659f8a9014f5 tempest-GroupsTest-1757050789 None] Group tempest-GroupsTest-Group-444251941: created successfully
Sep 10 19:29:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-dd03a758-b302-442f-8b43-659f8a9014f5 tempest-GroupsTest-1757050789 None] Create group completed successfully.
Sep 10 19:29:35 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Flow 'volume_create_manager' (d2bf8498-ec42-4891-93c3-53c823417118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609b0e33-46d0-4bcb-a3aa-f64bfc2e6a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609b0e33-46d0-4bcb-a3aa-f64bfc2e6a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-389403100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed883a17-2913-449d-8177-bac65bb94981,host='devstack@QuobyteHD#QuobyteHD',id=5b3bc45a-b64a-4467-81dc-a4a8d15cbd19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e530ecb742e444b8390db36047c14ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:29:35Z,use_quota=True,user_id='3f59321fe3324f9da79f5f227b85ae83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(636001b1-d414-4c27-9d60-9bcb6bda6baa),volume_type_id=636001b1-d414-4c27-9d60-9bcb6bda6baa)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a58390-82e2-4bc8-af31-c6738891a19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a58390-82e2-4bc8-af31-c6738891a19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86de3385-e6e0-415c-9689-7e7d886cd963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86de3385-e6e0-415c-9689-7e7d886cd963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3bc45a-b64a-4467-81dc-a4a8d15cbd19', 'volume_name': 'volume-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83486eb3-2bf7-4be5-aa42-ba82efe99926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83486eb3-2bf7-4be5-aa42-ba82efe99926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86f7e78-6c57-48a1-863b-ccda2796a838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:35 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Volume 5b3bc45a-b64a-4467-81dc-a4a8d15cbd19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19', 'volume_size': 1}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ed883a17-2913-449d-8177-bac65bb94981,created_at=2025-09-10T17:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-389403100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed883a17-2913-449d-8177-bac65bb94981,host='devstack@QuobyteHD#QuobyteHD',id=5b3bc45a-b64a-4467-81dc-a4a8d15cbd19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e530ecb742e444b8390db36047c14ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:29:35Z,use_quota=True,user_id='3f59321fe3324f9da79f5f227b85ae83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(636001b1-d414-4c27-9d60-9bcb6bda6baa),volume_type_id=636001b1-d414-4c27-9d60-9bcb6bda6baa)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Creating volume 5b3bc45a-b64a-4467-81dc-a4a8d15cbd19 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:29:35 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:29:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:35 devstack quobyte-client[82855]: System call of process 88893 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:29:35 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=30, name=volume-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:29:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19 1073741824" returned: 0 in 0.476s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19" returned: 0 in 0.216s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] <== create_volume: return (767ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:29:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:29:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86f7e78-6c57-48a1-863b-ccda2796a838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8168da7d-f3c9-4dcf-b2c4-064c61ef8565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:36 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Volume volume-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19 (5b3bc45a-b64a-4467-81dc-a4a8d15cbd19): created successfully
Sep 10 19:29:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8168da7d-f3c9-4dcf-b2c4-064c61ef8565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Flow 'volume_create_manager' (d2bf8498-ec42-4891-93c3-53c823417118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:29:36 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-51ee2999-f6ab-442b-ba14-504947cc642a tempest-GroupsTest-1757050789 None] Created volume successfully.
Sep 10 19:29:38 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Flow 'volume_create_manager' (87033342-dd52-4e43-921b-098a424dda06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8fe8a6-b547-4979-bb89-f09ad5a67083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8fe8a6-b547-4979-bb89-f09ad5a67083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-581593948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed883a17-2913-449d-8177-bac65bb94981,host='devstack@QuobyteHD#QuobyteHD',id=405c3a27-a647-4429-a57b-19bf5b2bfce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e530ecb742e444b8390db36047c14ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:29:39Z,use_quota=True,user_id='3f59321fe3324f9da79f5f227b85ae83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(636001b1-d414-4c27-9d60-9bcb6bda6baa),volume_type_id=636001b1-d414-4c27-9d60-9bcb6bda6baa)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378ef2ce-18ee-4cf5-918b-ec56cbb2a7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378ef2ce-18ee-4cf5-918b-ec56cbb2a7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4babb6b2-b831-4ae3-ae2b-d7fd083f1d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4babb6b2-b831-4ae3-ae2b-d7fd083f1d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '405c3a27-a647-4429-a57b-19bf5b2bfce0', 'volume_name': 'volume-405c3a27-a647-4429-a57b-19bf5b2bfce0', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5b8f3c-843c-43d4-87db-d9928a5907ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5b8f3c-843c-43d4-87db-d9928a5907ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94ac61a-6c3c-4e4e-851b-5f50732f71ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:39 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Volume 405c3a27-a647-4429-a57b-19bf5b2bfce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-405c3a27-a647-4429-a57b-19bf5b2bfce0', 'volume_size': 1}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ed883a17-2913-449d-8177-bac65bb94981,created_at=2025-09-10T17:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-581593948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed883a17-2913-449d-8177-bac65bb94981,host='devstack@QuobyteHD#QuobyteHD',id=405c3a27-a647-4429-a57b-19bf5b2bfce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e530ecb742e444b8390db36047c14ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:29:39Z,use_quota=True,user_id='3f59321fe3324f9da79f5f227b85ae83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(636001b1-d414-4c27-9d60-9bcb6bda6baa),volume_type_id=636001b1-d414-4c27-9d60-9bcb6bda6baa)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Creating volume 405c3a27-a647-4429-a57b-19bf5b2bfce0 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:29:39 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-405c3a27-a647-4429-a57b-19bf5b2bfce0 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:39 devstack quobyte-client[82855]: System call of process 88897 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:29:39 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=31, name=volume-405c3a27-a647-4429-a57b-19bf5b2bfce0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:29:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-405c3a27-a647-4429-a57b-19bf5b2bfce0 1073741824" returned: 0 in 0.618s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-405c3a27-a647-4429-a57b-19bf5b2bfce0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-405c3a27-a647-4429-a57b-19bf5b2bfce0" returned: 0 in 0.262s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] <== create_volume: return (1131ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:29:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:29:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94ac61a-6c3c-4e4e-851b-5f50732f71ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-405c3a27-a647-4429-a57b-19bf5b2bfce0', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a880dfe-b109-47f9-991c-122c2d3ba4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:29:41 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Volume volume-405c3a27-a647-4429-a57b-19bf5b2bfce0 (405c3a27-a647-4429-a57b-19bf5b2bfce0): created successfully
Sep 10 19:29:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a880dfe-b109-47f9-991c-122c2d3ba4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:29:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Flow 'volume_create_manager' (87033342-dd52-4e43-921b-098a424dda06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:29:41 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2754d989-dd36-421a-b003-44d772ca81d5 tempest-GroupsTest-1757050789 None] Created volume successfully.
Sep 10 19:29:42 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-054404b2-50fe-4d14-bacd-0e8eb099aa35 tempest-GroupsTest-1757050789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:29:43 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-054404b2-50fe-4d14-bacd-0e8eb099aa35 tempest-GroupsTest-1757050789 None] Update group completed successfully.
Sep 10 19:29:44 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d14365c3-e13c-4de5-93c4-9902c4025ff2 tempest-GroupsTest-1757050789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:29:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d14365c3-e13c-4de5-93c4-9902c4025ff2 tempest-GroupsTest-1757050789 None] Update group completed successfully.
Sep 10 19:29:46 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:29:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Acquiring lock "cinder-quobyte-405c3a27-a647-4429-a57b-19bf5b2bfce0" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:29:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Lock "cinder-quobyte-405c3a27-a647-4429-a57b-19bf5b2bfce0" acquired by "delete_volume" :: waited 0.030s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:29:46 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a8d7ca-5cdf-4111-835a-9366b92077d9]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:29:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-405c3a27-a647-4429-a57b-19bf5b2bfce0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-405c3a27-a647-4429-a57b-19bf5b2bfce0" returned: 0 in 0.517s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-405c3a27-a647-4429-a57b-19bf5b2bfce0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-405c3a27-a647-4429-a57b-19bf5b2bfce0" returned: 0 in 0.100s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Lock "cinder-quobyte-405c3a27-a647-4429-a57b-19bf5b2bfce0" released by "delete_volume" :: held 0.796s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:29:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Acquiring lock "cinder-quobyte-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:29:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Lock "cinder-quobyte-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19" acquired by "delete_volume" :: waited 0.026s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:29:46 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc292032-2197-4b89-83de-b87cef4934e3]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:29:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19" returned: 0 in 0.585s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19" returned: 0 in 0.109s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Lock "cinder-quobyte-5b3bc45a-b64a-4467-81dc-a4a8d15cbd19" released by "delete_volume" :: held 0.894s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:29:48 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Created reservations ['c0a30a36-ec4a-43d0-9a82-a984d2000011'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:29:48 devstack cinder-volume[82850]: WARNING cinder.quota [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1007320611 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1007320611, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:29:48 devstack cinder-volume[82850]: WARNING cinder.quota [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1007320611 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1007320611, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:29:48 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Created reservations ['9e03d0d3-103a-4ad8-910b-991af8214fac', 'de6bb9d2-3c3d-44f1-856f-83a79fb32124', '3284c983-1937-4a3f-a198-6eabb3be7a9d', '937b32f8-0c58-4087-a585-d37ab96026f3'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:29:48 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Created reservations ['eb7b4b72-af1e-4668-8ced-33d8904ee414', 'dc69140e-5af6-482f-80fc-62cffb8054fe', '8ef31fa8-b646-4d3b-8a4b-c3cc6f38ae5b', '74edb3a7-3e29-4f91-aa22-ce0598b8fe1d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:29:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:29:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:29:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:29:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:29:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:29:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.114s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:48 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:29:48 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a39ae0f1-976e-4c5b-80c0-d09baeffba8a tempest-GroupsTest-1757050789 None] Delete group completed successfully.
Sep 10 19:29:58 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=44,cinder:UPDATE=40,cinder:INSERT=4,cinder:DELETE=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:29:58 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=39,cinder:UPDATE=46,cinder:DELETE=1,cinder:INSERT=11 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:29:59 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-61004df2-6e9a-410d-a4fa-e2a34bb11df5 tempest-GroupsV320Test-1504919392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:29:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-61004df2-6e9a-410d-a4fa-e2a34bb11df5 tempest-GroupsV320Test-1504919392 None] Group tempest-GroupsV320Test-Group-1134655446: creating
Sep 10 19:29:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-61004df2-6e9a-410d-a4fa-e2a34bb11df5 tempest-GroupsV320Test-1504919392 None] Group tempest-GroupsV320Test-Group-1134655446: created successfully
Sep 10 19:29:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-61004df2-6e9a-410d-a4fa-e2a34bb11df5 tempest-GroupsV320Test-1504919392 None] Create group completed successfully.
Sep 10 19:30:00 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-9fdecd86-20b3-4307-afc3-420e799f8bc3 tempest-GroupsV320Test-1504919392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:30:00 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-9fdecd86-20b3-4307-afc3-420e799f8bc3 tempest-GroupsV320Test-1504919392 None] Created reservations ['a6d26f11-21a8-45e0-8f3a-0194d79e4111'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:30:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9fdecd86-20b3-4307-afc3-420e799f8bc3 tempest-GroupsV320Test-1504919392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:30:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9fdecd86-20b3-4307-afc3-420e799f8bc3 tempest-GroupsV320Test-1504919392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:30:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9fdecd86-20b3-4307-afc3-420e799f8bc3 tempest-GroupsV320Test-1504919392 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:30:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9fdecd86-20b3-4307-afc3-420e799f8bc3 tempest-GroupsV320Test-1504919392 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:30:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9fdecd86-20b3-4307-afc3-420e799f8bc3 tempest-GroupsV320Test-1504919392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:30:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9fdecd86-20b3-4307-afc3-420e799f8bc3 tempest-GroupsV320Test-1504919392 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9fdecd86-20b3-4307-afc3-420e799f8bc3 tempest-GroupsV320Test-1504919392 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.269s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:01 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-9fdecd86-20b3-4307-afc3-420e799f8bc3 tempest-GroupsV320Test-1504919392 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:30:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9fdecd86-20b3-4307-afc3-420e799f8bc3 tempest-GroupsV320Test-1504919392 None] Delete group completed successfully.
Sep 10 19:30:10 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=4,cinder:SELECT=4 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:30:11 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:30:13 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:30:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:30:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:30:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:30:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:30:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:30:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.476s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:30:28 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Flow 'volume_create_manager' (e17db462-0b83-4d55-aad9-05b98662ff63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87082622-a3f4-41f8-a522-f8343ac0ff3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87082622-a3f4-41f8-a522-f8343ac0ff3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-45947320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a111e336-120b-4336-adbf-2c4a76a32a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88f5c19b42343eba62fe91e071f5d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:30:29Z,use_quota=True,user_id='7ca1baeecde94105b2e77a97bc354a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbbb80b0-efea-4ddf-a077-7a743a71e278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbbb80b0-efea-4ddf-a077-7a743a71e278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a57a87-2c81-4570-87e1-b8afc9d31fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a57a87-2c81-4570-87e1-b8afc9d31fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a111e336-120b-4336-adbf-2c4a76a32a20', 'volume_name': 'volume-a111e336-120b-4336-adbf-2c4a76a32a20', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aac0d29-ccb2-4519-ad0f-f823f4b3e53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aac0d29-ccb2-4519-ad0f-f823f4b3e53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168e2b85-738c-4f1b-8d75-36403e7e5fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:29 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Volume a111e336-120b-4336-adbf-2c4a76a32a20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a111e336-120b-4336-adbf-2c4a76a32a20', 'volume_size': 1}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-45947320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a111e336-120b-4336-adbf-2c4a76a32a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88f5c19b42343eba62fe91e071f5d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:30:29Z,use_quota=True,user_id='7ca1baeecde94105b2e77a97bc354a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Creating volume a111e336-120b-4336-adbf-2c4a76a32a20 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:30:29 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:30:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a111e336-120b-4336-adbf-2c4a76a32a20 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:30 devstack quobyte-client[82855]: System call of process 89116 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:30:30 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=32, name=volume-a111e336-120b-4336-adbf-2c4a76a32a20, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:30:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a111e336-120b-4336-adbf-2c4a76a32a20 1073741824" returned: 0 in 0.864s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a111e336-120b-4336-adbf-2c4a76a32a20 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a111e336-120b-4336-adbf-2c4a76a32a20" returned: 0 in 0.161s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] <== create_volume: return (1181ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:30:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:30:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168e2b85-738c-4f1b-8d75-36403e7e5fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a111e336-120b-4336-adbf-2c4a76a32a20', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde873b0-2641-4aa4-be06-36d261ca22d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:31 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Volume volume-a111e336-120b-4336-adbf-2c4a76a32a20 (a111e336-120b-4336-adbf-2c4a76a32a20): created successfully
Sep 10 19:30:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde873b0-2641-4aa4-be06-36d261ca22d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Flow 'volume_create_manager' (e17db462-0b83-4d55-aad9-05b98662ff63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:30:31 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-175ba922-b32b-4dc4-a908-c9f5495bdfb1 tempest-AttachVolumeShelveTestJSON-254880779 None] Created volume successfully.
Sep 10 19:30:32 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Flow 'volume_create_manager' (88486489-6f33-41f9-af05-67b9eb04f89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650bbfdb-3776-45a0-9af3-953dace810f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650bbfdb-3776-45a0-9af3-953dace810f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-410000435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd40e74-210c-46df-bea0-0537c46b76f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e038c595c86438da13c64ce22a86407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:30:33Z,use_quota=True,user_id='e2322a03907f4aeb962d641e717cb6a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56567082-9117-4d2c-acc9-24b9277ded3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56567082-9117-4d2c-acc9-24b9277ded3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8345bd90-e43a-4738-a236-c935b2e1ec04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8345bd90-e43a-4738-a236-c935b2e1ec04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dd40e74-210c-46df-bea0-0537c46b76f8', 'volume_name': 'volume-2dd40e74-210c-46df-bea0-0537c46b76f8', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5729484-67a4-45d7-9132-870cb8b2472b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5729484-67a4-45d7-9132-870cb8b2472b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d0753b-21b2-447f-bd3a-4436b9ea3a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:32 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Volume 2dd40e74-210c-46df-bea0-0537c46b76f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dd40e74-210c-46df-bea0-0537c46b76f8', 'volume_size': 1}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-410000435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd40e74-210c-46df-bea0-0537c46b76f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e038c595c86438da13c64ce22a86407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:30:33Z,use_quota=True,user_id='e2322a03907f4aeb962d641e717cb6a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Creating volume 2dd40e74-210c-46df-bea0-0537c46b76f8 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:30:32 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:30:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:33 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=33, name=volume-2dd40e74-210c-46df-bea0-0537c46b76f8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:30:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8 1073741824" returned: 0 in 0.483s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8" returned: 0 in 0.246s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] <== create_volume: return (792ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:30:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:30:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d0753b-21b2-447f-bd3a-4436b9ea3a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dd40e74-210c-46df-bea0-0537c46b76f8', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a23ad5a0-ddf0-486e-98e2-1f1a15034922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:33 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Volume volume-2dd40e74-210c-46df-bea0-0537c46b76f8 (2dd40e74-210c-46df-bea0-0537c46b76f8): created successfully
Sep 10 19:30:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a23ad5a0-ddf0-486e-98e2-1f1a15034922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Flow 'volume_create_manager' (88486489-6f33-41f9-af05-67b9eb04f89a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:30:33 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9156ae0f-9ed2-4624-a7a2-85040fb56857 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Created volume successfully.
Sep 10 19:30:35 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:30:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:30:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:30:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Creating offline snapshot 6271ad19-5653-4ae6-a704-3625d0ae0c3f of volume 2dd40e74-210c-46df-bea0-0537c46b76f8 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:30:35 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f9ff79-3895-4522-8c25-81081c5ba320]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:30:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8" returned: 0 in 0.412s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:36 devstack quobyte-client[82855]: System call of process 89132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:30:36 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=34, name=volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:30:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f 1G" returned: 0 in 0.272s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2dd40e74-210c-46df-bea0-0537c46b76f8 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:36 devstack quobyte-client[82855]: System call of process 89135 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:30:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "qemu-img rebase -u -b volume-2dd40e74-210c-46df-bea0-0537c46b76f8 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f" returned: 0 in 0.460s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:30:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f" returned: 0 in 0.438s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:30:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f" returned: 0 in 0.160s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.info" returned: 0 in 0.635s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:30:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.info" returned: 0 in 0.157s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.226s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:30:39 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3b9c50b4-d7c9-49ed-b5a6-2aa891cdb285 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Create snapshot completed successfully
Sep 10 19:30:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Acquiring lock "cinder-6271ad19-5653-4ae6-a704-3625d0ae0c3f-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:30:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "cinder-6271ad19-5653-4ae6-a704-3625d0ae0c3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.107s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:30:41 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:30:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Acquiring lock "cinder-quobyte-2dd40e74-210c-46df-bea0-0537c46b76f8" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:30:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "cinder-quobyte-2dd40e74-210c-46df-bea0-0537c46b76f8" acquired by "delete_snapshot" :: waited 0.038s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:30:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Acquiring lock "cinder-quobyte-6271ad19-5653-4ae6-a704-3625d0ae0c3f" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:30:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "cinder-quobyte-6271ad19-5653-4ae6-a704-3625d0ae0c3f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:30:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Deleting offline snapshot 6271ad19-5653-4ae6-a704-3625d0ae0c3f of volume 2dd40e74-210c-46df-bea0-0537c46b76f8 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:30:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] snapshot_file for this snap is: volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:30:41 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ff101d-5f3e-4c7e-ae36-16726cf19710]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:30:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:42 devstack quobyte-client[82855]: System call of process 89189 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:30:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f" returned: 0 in 1.020s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dd40e74-210c-46df-bea0-0537c46b76f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:30:42 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[645608a3-68de-4826-b360-f21f2a75e357]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:30:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8" returned: 0 in 0.793s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:43 devstack quobyte-client[82855]: System call of process 89232 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:30:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f" returned: 0 in 0.497s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8.6271ad19-5653-4ae6-a704-3625d0ae0c3f" returned: 0 in 0.142s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "cinder-quobyte-6271ad19-5653-4ae6-a704-3625d0ae0c3f" released by "_delete_snapshot" :: held 2.947s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:30:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "cinder-quobyte-2dd40e74-210c-46df-bea0-0537c46b76f8" released by "delete_snapshot" :: held 2.976s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:30:44 devstack cinder-volume[82850]: WARNING cinder.quota [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:30:44 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Created reservations ['457f5139-33af-46d8-967d-6f2d91d79874', 'fb54690e-e931-4ad6-baba-1144cede540c', '4c2d6c58-9e32-4276-81af-fd3dc1b9aba1', '41c9b188-1f77-4154-af0c-3bc9382a08e1'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:30:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Delete snapshot completed successfully.
Sep 10 19:30:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3839e4ed-b307-4261-880a-6c34614d92a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "cinder-6271ad19-5653-4ae6-a704-3625d0ae0c3f-delete_snapshot" released by "delete_snapshot" :: held 3.713s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:30:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Acquiring lock "cinder-2dd40e74-210c-46df-bea0-0537c46b76f8-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:30:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "cinder-2dd40e74-210c-46df-bea0-0537c46b76f8-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:30:45 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:30:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Acquiring lock "cinder-quobyte-2dd40e74-210c-46df-bea0-0537c46b76f8" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:30:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "cinder-quobyte-2dd40e74-210c-46df-bea0-0537c46b76f8" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:30:46 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6e34e1-9f6e-472d-a2f3-20f2c01131a3]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:30:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8" returned: 0 in 0.885s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2dd40e74-210c-46df-bea0-0537c46b76f8" returned: 0 in 0.178s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "cinder-quobyte-2dd40e74-210c-46df-bea0-0537c46b76f8" released by "delete_volume" :: held 1.314s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:30:47 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Created reservations ['821c3bb5-8524-44db-840a-c1024a328cbf', 'cfd27eae-6261-436f-9f8a-4c9107190621', '20ace5a6-796c-48dc-86d5-07c7317442b5', '29abbec9-12f7-4e36-8afc-345b721814df'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:30:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:30:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:30:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:30:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:30:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:30:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.119s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:47 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:30:47 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Deleted volume successfully.
Sep 10 19:30:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-818e8ff7-51a4-4e3a-b0df-d68e5530e6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-255363180 None] Lock "cinder-2dd40e74-210c-46df-bea0-0537c46b76f8-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:30:57 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=15,cinder:SELECT=13,cinder:INSERT=7 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:30:58 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=13,cinder:UPDATE=22,cinder:DELETE=4,cinder:INSERT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:31:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-77d00642-92f3-40f3-b1a7-5781ab2f94d0 req-6f3116f6-014a-4085-833e-7577691176ae tempest-AttachVolumeShelveTestJSON-254880779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:31:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-77d00642-92f3-40f3-b1a7-5781ab2f94d0 req-6f3116f6-014a-4085-833e-7577691176ae tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:31:01 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc56519-1d79-48a5-987a-dc6d0db7bd0d]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:31:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-77d00642-92f3-40f3-b1a7-5781ab2f94d0 req-6f3116f6-014a-4085-833e-7577691176ae tempest-AttachVolumeShelveTestJSON-254880779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a111e336-120b-4336-adbf-2c4a76a32a20 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:31:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-77d00642-92f3-40f3-b1a7-5781ab2f94d0 req-6f3116f6-014a-4085-833e-7577691176ae tempest-AttachVolumeShelveTestJSON-254880779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a111e336-120b-4336-adbf-2c4a76a32a20" returned: 0 in 0.517s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:31:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-77d00642-92f3-40f3-b1a7-5781ab2f94d0 req-6f3116f6-014a-4085-833e-7577691176ae tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.579s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:31:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-77d00642-92f3-40f3-b1a7-5781ab2f94d0 req-6f3116f6-014a-4085-833e-7577691176ae tempest-AttachVolumeShelveTestJSON-254880779 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-a111e336-120b-4336-adbf-2c4a76a32a20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1d85b7d-089d-4ef8-b527-da80225bb6f7', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:31:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-77d00642-92f3-40f3-b1a7-5781ab2f94d0 req-6f3116f6-014a-4085-833e-7577691176ae tempest-AttachVolumeShelveTestJSON-254880779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:31:02 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-77d00642-92f3-40f3-b1a7-5781ab2f94d0 req-6f3116f6-014a-4085-833e-7577691176ae tempest-AttachVolumeShelveTestJSON-254880779 None] attachment_update completed successfully.
Sep 10 19:31:12 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:31:12 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:31:13 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:31:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:31:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:31:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:31:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:31:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:31:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:31:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.415s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:31:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:31:24 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Flow 'volume_create_manager' (202f1ec7-ca1e-46bb-b1ff-887f6dfa7804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d3a23d-0d15-4da9-b1b5-2a11d259a6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d3a23d-0d15-4da9-b1b5-2a11d259a6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1623460353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e41cd269a9444c69db58e830bf56ca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:31:24Z,use_quota=True,user_id='24926c90844a4da8a5295a9d3c646c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6d6048-c23e-4c21-bdbf-d2a8fb9ebdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6d6048-c23e-4c21-bdbf-d2a8fb9ebdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00782b1-88cb-421d-b89d-4ae5823eb5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00782b1-88cb-421d-b89d-4ae5823eb5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7', 'volume_name': 'volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694e12cb-e747-497c-8114-96d73fd0933d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694e12cb-e747-497c-8114-96d73fd0933d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b108d44-542f-4f20-b347-230ed677743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:31:25 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Volume cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7', 'volume_size': 1}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1623460353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e41cd269a9444c69db58e830bf56ca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:31:24Z,use_quota=True,user_id='24926c90844a4da8a5295a9d3c646c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Creating volume cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:31:25 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:31:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:31:26 devstack quobyte-client[82855]: System call of process 89385 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:31:26 devstack quobyte-client[82855]: System call of process 89385 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:31:26 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=36, name=volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:31:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7 1073741824" returned: 0 in 1.096s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:31:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:31:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7" returned: 0 in 0.224s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:31:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] <== create_volume: return (1606ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:31:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:31:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b108d44-542f-4f20-b347-230ed677743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:31:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b351f339-c91c-4bb3-804f-398efbada601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:31:27 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Volume volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7 (cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7): created successfully
Sep 10 19:31:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b351f339-c91c-4bb3-804f-398efbada601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:31:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Flow 'volume_create_manager' (202f1ec7-ca1e-46bb-b1ff-887f6dfa7804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:31:27 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-60959fd9-39c6-462c-aff8-504336d2247e tempest-AttachVolumeNegativeTest-1515327604 None] Created volume successfully.
Sep 10 19:31:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-eec378ea-711f-48ba-9e81-2ede730800ae req-327d49e7-46f5-439a-b77c-fc88580206c8 tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:31:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-eec378ea-711f-48ba-9e81-2ede730800ae req-327d49e7-46f5-439a-b77c-fc88580206c8 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:31:32 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ace038-e927-460a-b65f-d1873d7f0b27]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:31:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-eec378ea-711f-48ba-9e81-2ede730800ae req-327d49e7-46f5-439a-b77c-fc88580206c8 tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:31:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-eec378ea-711f-48ba-9e81-2ede730800ae req-327d49e7-46f5-439a-b77c-fc88580206c8 tempest-AttachVolumeNegativeTest-1515327604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7" returned: 0 in 0.681s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:31:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-eec378ea-711f-48ba-9e81-2ede730800ae req-327d49e7-46f5-439a-b77c-fc88580206c8 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.807s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:31:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-eec378ea-711f-48ba-9e81-2ede730800ae req-327d49e7-46f5-439a-b77c-fc88580206c8 tempest-AttachVolumeNegativeTest-1515327604 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07a1b13a-eee3-4b7b-ad9a-26bbd0d0e6d3', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:31:33 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-eec378ea-711f-48ba-9e81-2ede730800ae req-327d49e7-46f5-439a-b77c-fc88580206c8 tempest-AttachVolumeNegativeTest-1515327604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:31:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-eec378ea-711f-48ba-9e81-2ede730800ae req-327d49e7-46f5-439a-b77c-fc88580206c8 tempest-AttachVolumeNegativeTest-1515327604 None] attachment_update completed successfully.
Sep 10 19:31:44 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=5,cinder:SELECT=6 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:31:44 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:32:07 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-6f4dfde7-15f9-4b4f-bb07-66fc8644330a req-e46a2ec4-fe70-4f10-98ac-ecb6fe7c358f tempest-AttachVolumeNegativeTest-1515327604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:32:07 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-6f4dfde7-15f9-4b4f-bb07-66fc8644330a req-e46a2ec4-fe70-4f10-98ac-ecb6fe7c358f tempest-AttachVolumeNegativeTest-1515327604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:32:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-6f4dfde7-15f9-4b4f-bb07-66fc8644330a req-e46a2ec4-fe70-4f10-98ac-ecb6fe7c358f tempest-AttachVolumeNegativeTest-1515327604 None] Terminate volume connection completed successfully.
Sep 10 19:32:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-6f4dfde7-15f9-4b4f-bb07-66fc8644330a req-e46a2ec4-fe70-4f10-98ac-ecb6fe7c358f tempest-AttachVolumeNegativeTest-1515327604 None] Deleting attachment 07a1b13a-eee3-4b7b-ad9a-26bbd0d0e6d3. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:32:13 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:32:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:32:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:32:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:32:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:32:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.118s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:32:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:32:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.446s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:32:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:32:17 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:32:17 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:32:30 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Flow 'volume_create_manager' (119b481c-63d9-45c8-ab32-7f0c8ace72a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5c08cf-06cb-4a87-b61b-9581496d3d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5c08cf-06cb-4a87-b61b-9581496d3d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1282951349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6343c4-0a84-47cd-96dd-6ec2505699ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e640e98e37f4513bc8b7328ee0d10da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:32:30Z,use_quota=True,user_id='9ad7752bbcf34acf8562ff85a5a4e61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e0393d-8303-46ed-9742-3acbfa909a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e0393d-8303-46ed-9742-3acbfa909a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e5bfaa-7c3e-4de9-9eba-da262b81b983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e5bfaa-7c3e-4de9-9eba-da262b81b983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec6343c4-0a84-47cd-96dd-6ec2505699ce', 'volume_name': 'volume-ec6343c4-0a84-47cd-96dd-6ec2505699ce', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c419bf-3652-4627-a313-3906edc6372e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c419bf-3652-4627-a313-3906edc6372e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3b3656-702f-43c9-9bc6-d2f03f8faccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:30 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Volume ec6343c4-0a84-47cd-96dd-6ec2505699ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec6343c4-0a84-47cd-96dd-6ec2505699ce', 'volume_size': 1}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1282951349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6343c4-0a84-47cd-96dd-6ec2505699ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e640e98e37f4513bc8b7328ee0d10da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:32:30Z,use_quota=True,user_id='9ad7752bbcf34acf8562ff85a5a4e61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Creating volume ec6343c4-0a84-47cd-96dd-6ec2505699ce {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:32:30 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:32:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ec6343c4-0a84-47cd-96dd-6ec2505699ce 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:32:30 devstack quobyte-client[82855]: System call of process 90158 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:32:30 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=37, name=volume-ec6343c4-0a84-47cd-96dd-6ec2505699ce, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:32:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ec6343c4-0a84-47cd-96dd-6ec2505699ce 1073741824" returned: 0 in 0.927s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:32:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ec6343c4-0a84-47cd-96dd-6ec2505699ce {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:32:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ec6343c4-0a84-47cd-96dd-6ec2505699ce" returned: 0 in 0.237s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:32:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] <== create_volume: return (1299ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:32:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:32:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3b3656-702f-43c9-9bc6-d2f03f8faccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec6343c4-0a84-47cd-96dd-6ec2505699ce', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ddf637-7a1e-4c37-81ab-794a31562eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:32 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Volume volume-ec6343c4-0a84-47cd-96dd-6ec2505699ce (ec6343c4-0a84-47cd-96dd-6ec2505699ce): created successfully
Sep 10 19:32:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ddf637-7a1e-4c37-81ab-794a31562eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Flow 'volume_create_manager' (119b481c-63d9-45c8-ab32-7f0c8ace72a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:32:32 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9591baa2-293a-4f2b-8c50-1379f01544fc tempest-VolumesActionsTest-1357807624 None] Created volume successfully.
Sep 10 19:32:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1dcc6073-1cc4-4310-b0d4-1c378c603153 tempest-VolumesActionsTest-1357807624 None] Acquiring lock "cinder-ec6343c4-0a84-47cd-96dd-6ec2505699ce" by "attach_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:32:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1dcc6073-1cc4-4310-b0d4-1c378c603153 tempest-VolumesActionsTest-1357807624 None] Lock "cinder-ec6343c4-0a84-47cd-96dd-6ec2505699ce" acquired by "attach_volume" :: waited 0.076s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:32:33 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-1dcc6073-1cc4-4310-b0d4-1c378c603153 tempest-VolumesActionsTest-1357807624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:32:33 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1dcc6073-1cc4-4310-b0d4-1c378c603153 tempest-VolumesActionsTest-1357807624 None] Attaching volume ec6343c4-0a84-47cd-96dd-6ec2505699ce to instance c51bd806-c690-45f9-9006-9f66efd9298c at mountpoint /dev/vdb on host None.
Sep 10 19:32:33 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1dcc6073-1cc4-4310-b0d4-1c378c603153 tempest-VolumesActionsTest-1357807624 None] Attach volume completed successfully.
Sep 10 19:32:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1dcc6073-1cc4-4310-b0d4-1c378c603153 tempest-VolumesActionsTest-1357807624 None] Lock "cinder-ec6343c4-0a84-47cd-96dd-6ec2505699ce" released by "attach_volume" :: held 0.450s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:32:34 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-92be411a-622b-4afb-afaa-5aefde93c935 tempest-VolumesActionsTest-1425939557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:32:35 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-92be411a-622b-4afb-afaa-5aefde93c935 tempest-VolumesActionsTest-1425939557 None] Terminate volume connection completed successfully.
Sep 10 19:32:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-92be411a-622b-4afb-afaa-5aefde93c935 tempest-VolumesActionsTest-1425939557 None] Acquiring lock "cinder-ec6343c4-0a84-47cd-96dd-6ec2505699ce-detach_volume" by "detach_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:32:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-92be411a-622b-4afb-afaa-5aefde93c935 tempest-VolumesActionsTest-1425939557 None] Lock "cinder-ec6343c4-0a84-47cd-96dd-6ec2505699ce-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:32:35 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-92be411a-622b-4afb-afaa-5aefde93c935 tempest-VolumesActionsTest-1425939557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:32:35 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-92be411a-622b-4afb-afaa-5aefde93c935 tempest-VolumesActionsTest-1425939557 None] Detaching volume ec6343c4-0a84-47cd-96dd-6ec2505699ce from instance c51bd806-c690-45f9-9006-9f66efd9298c.
Sep 10 19:32:35 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-92be411a-622b-4afb-afaa-5aefde93c935 tempest-VolumesActionsTest-1425939557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:32:35 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-92be411a-622b-4afb-afaa-5aefde93c935 tempest-VolumesActionsTest-1425939557 None] Detach volume completed successfully.
Sep 10 19:32:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-92be411a-622b-4afb-afaa-5aefde93c935 tempest-VolumesActionsTest-1425939557 None] Lock "cinder-ec6343c4-0a84-47cd-96dd-6ec2505699ce-detach_volume" released by "detach_volume" :: held 0.239s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:32:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b7b4dba4-afd1-451d-89af-61f63a433fc7 tempest-VolumesActionsTest-1357807624 None] Acquiring lock "cinder-ec6343c4-0a84-47cd-96dd-6ec2505699ce-detach_volume" by "detach_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:32:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b7b4dba4-afd1-451d-89af-61f63a433fc7 tempest-VolumesActionsTest-1357807624 None] Lock "cinder-ec6343c4-0a84-47cd-96dd-6ec2505699ce-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:32:36 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b7b4dba4-afd1-451d-89af-61f63a433fc7 tempest-VolumesActionsTest-1357807624 None] Volume detach called, but volume not attached.
Sep 10 19:32:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b7b4dba4-afd1-451d-89af-61f63a433fc7 tempest-VolumesActionsTest-1357807624 None] Lock "cinder-ec6343c4-0a84-47cd-96dd-6ec2505699ce-detach_volume" released by "detach_volume" :: held 0.018s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:32:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Acquiring lock "cinder-ec6343c4-0a84-47cd-96dd-6ec2505699ce-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:32:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Lock "cinder-ec6343c4-0a84-47cd-96dd-6ec2505699ce-delete_volume" acquired by "delete_volume" :: waited 0.187s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:32:37 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:32:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Acquiring lock "cinder-quobyte-ec6343c4-0a84-47cd-96dd-6ec2505699ce" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:32:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Lock "cinder-quobyte-ec6343c4-0a84-47cd-96dd-6ec2505699ce" acquired by "delete_volume" :: waited 0.035s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:32:37 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[78db37b0-663e-45ca-89a8-fc3afe960b4b]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:32:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ec6343c4-0a84-47cd-96dd-6ec2505699ce {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:32:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ec6343c4-0a84-47cd-96dd-6ec2505699ce" returned: 0 in 0.629s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:32:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ec6343c4-0a84-47cd-96dd-6ec2505699ce {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:32:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ec6343c4-0a84-47cd-96dd-6ec2505699ce" returned: 0 in 0.156s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:32:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Lock "cinder-quobyte-ec6343c4-0a84-47cd-96dd-6ec2505699ce" released by "delete_volume" :: held 1.321s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:32:39 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Created reservations ['8c3ef5f9-1957-4eac-875d-9a6a81015a87', '80830b55-f552-4405-903b-d677fa27b4d2', 'd6c993aa-aa90-4cc2-8402-5e729328c950', 'ecb84608-84f0-47ca-bab6-75253cca0de1'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:32:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:32:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:32:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:32:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:32:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:32:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:32:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.434s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:32:40 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:32:41 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Deleted volume successfully.
Sep 10 19:32:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-bd2e7d21-2c3e-4648-a3d1-6671b954d08b tempest-VolumesActionsTest-1357807624 None] Lock "cinder-ec6343c4-0a84-47cd-96dd-6ec2505699ce-delete_volume" released by "delete_volume" :: held 4.486s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:32:49 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=14,cinder:UPDATE=14,cinder:INSERT=4 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:32:51 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=13,cinder:DELETE=2,cinder:SELECT=13,cinder:INSERT=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:32:57 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:32:57 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:32:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Flow 'volume_create_manager' (d6ee9fb0-850a-4a7e-a1f7-b43b4d89471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1fc750-841d-4c80-89ea-18ad8d875271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1fc750-841d-4c80-89ea-18ad8d875271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1738583038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f48b7078-def4-4e63-b36b-a878ee67f585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e640e98e37f4513bc8b7328ee0d10da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:32:58Z,use_quota=True,user_id='9ad7752bbcf34acf8562ff85a5a4e61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0c5eb3-6740-4a7f-91bc-454adedbb68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0c5eb3-6740-4a7f-91bc-454adedbb68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3fff2d1-2274-49dd-a0af-801d0273258d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3fff2d1-2274-49dd-a0af-801d0273258d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f48b7078-def4-4e63-b36b-a878ee67f585', 'volume_name': 'volume-f48b7078-def4-4e63-b36b-a878ee67f585', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea79489-9c9e-4e96-b2cb-52d9b7a9a2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea79489-9c9e-4e96-b2cb-52d9b7a9a2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792c7a65-fb27-40f5-b9b7-d324aa5b69c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:58 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Volume f48b7078-def4-4e63-b36b-a878ee67f585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f48b7078-def4-4e63-b36b-a878ee67f585', 'volume_size': 1}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1738583038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f48b7078-def4-4e63-b36b-a878ee67f585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e640e98e37f4513bc8b7328ee0d10da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:32:58Z,use_quota=True,user_id='9ad7752bbcf34acf8562ff85a5a4e61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Creating volume f48b7078-def4-4e63-b36b-a878ee67f585 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:32:58 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:32:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f48b7078-def4-4e63-b36b-a878ee67f585 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:32:58 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=38, name=volume-f48b7078-def4-4e63-b36b-a878ee67f585, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:32:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f48b7078-def4-4e63-b36b-a878ee67f585 1073741824" returned: 0 in 0.765s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:32:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f48b7078-def4-4e63-b36b-a878ee67f585 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:32:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f48b7078-def4-4e63-b36b-a878ee67f585" returned: 0 in 0.179s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:32:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] <== create_volume: return (1108ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:32:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:32:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792c7a65-fb27-40f5-b9b7-d324aa5b69c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f48b7078-def4-4e63-b36b-a878ee67f585', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5289d4c8-f8aa-4b10-afda-fe4bb7159e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:59 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Volume volume-f48b7078-def4-4e63-b36b-a878ee67f585 (f48b7078-def4-4e63-b36b-a878ee67f585): created successfully
Sep 10 19:32:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5289d4c8-f8aa-4b10-afda-fe4bb7159e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Flow 'volume_create_manager' (d6ee9fb0-850a-4a7e-a1f7-b43b4d89471d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:32:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-78eaab13-0569-4078-91a1-43030ce7181e tempest-VolumesActionsTest-1357807624 None] Created volume successfully.
Sep 10 19:33:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Acquiring lock "cinder-f48b7078-def4-4e63-b36b-a878ee67f585-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:33:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Lock "cinder-f48b7078-def4-4e63-b36b-a878ee67f585-delete_volume" acquired by "delete_volume" :: waited 0.298s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:33:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:33:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Acquiring lock "cinder-quobyte-f48b7078-def4-4e63-b36b-a878ee67f585" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:33:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Lock "cinder-quobyte-f48b7078-def4-4e63-b36b-a878ee67f585" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:33:02 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[00304863-af09-4b5b-a092-3a2cbed7b1ab]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:33:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f48b7078-def4-4e63-b36b-a878ee67f585 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f48b7078-def4-4e63-b36b-a878ee67f585" returned: 0 in 0.879s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f48b7078-def4-4e63-b36b-a878ee67f585 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f48b7078-def4-4e63-b36b-a878ee67f585" returned: 0 in 0.242s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Lock "cinder-quobyte-f48b7078-def4-4e63-b36b-a878ee67f585" released by "delete_volume" :: held 1.417s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:33:04 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Created reservations ['713c9bb4-70a7-426c-bbd1-86f72f79a669', '7bb32013-4e79-410b-9dea-42b2aa0dc996', '3ab975a0-d1da-4d56-887e-5b35b4b17ba9', '172228ab-3a13-4d4e-925a-7913721d2b71'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:33:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:33:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:33:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.282s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:05 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:33:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Deleted volume successfully.
Sep 10 19:33:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0cc13436-9432-406d-80d7-75564789dda4 tempest-VolumesActionsTest-1425939557 None] Lock "cinder-f48b7078-def4-4e63-b36b-a878ee67f585-delete_volume" released by "delete_volume" :: held 3.961s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:33:07 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Flow 'volume_create_manager' (2b9816bd-dd01-4131-9303-d96c50cbce5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea2b538-11bd-4858-830e-466e8e7e06e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea2b538-11bd-4858-830e-466e8e7e06e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-895049613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2beaec89-5a64-49bc-b479-f167dc05256d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e640e98e37f4513bc8b7328ee0d10da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:33:07Z,use_quota=True,user_id='9ad7752bbcf34acf8562ff85a5a4e61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f94592-fb4c-4577-914e-4365c29923f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f94592-fb4c-4577-914e-4365c29923f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e710d45f-0613-495f-8502-9d9a4930f0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e710d45f-0613-495f-8502-9d9a4930f0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2beaec89-5a64-49bc-b479-f167dc05256d', 'volume_name': 'volume-2beaec89-5a64-49bc-b479-f167dc05256d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654daea7-18aa-4e95-964d-4f2bf475bea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654daea7-18aa-4e95-964d-4f2bf475bea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95fa4589-bcf3-49fd-9dce-d9acf78265d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:07 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Volume 2beaec89-5a64-49bc-b479-f167dc05256d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2beaec89-5a64-49bc-b479-f167dc05256d', 'volume_size': 1}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-895049613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2beaec89-5a64-49bc-b479-f167dc05256d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e640e98e37f4513bc8b7328ee0d10da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:33:07Z,use_quota=True,user_id='9ad7752bbcf34acf8562ff85a5a4e61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Creating volume 2beaec89-5a64-49bc-b479-f167dc05256d {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:33:07 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:33:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2beaec89-5a64-49bc-b479-f167dc05256d 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:07 devstack quobyte-client[82855]: System call of process 90389 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:33:07 devstack quobyte-client[82855]: System call of process 90389 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:33:07 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=39, name=volume-2beaec89-5a64-49bc-b479-f167dc05256d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:33:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2beaec89-5a64-49bc-b479-f167dc05256d 1073741824" returned: 0 in 0.713s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2beaec89-5a64-49bc-b479-f167dc05256d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2beaec89-5a64-49bc-b479-f167dc05256d" returned: 0 in 0.177s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] <== create_volume: return (964ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:33:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95fa4589-bcf3-49fd-9dce-d9acf78265d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2beaec89-5a64-49bc-b479-f167dc05256d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d782564-94c2-4789-a332-e9eb80beba6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:08 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Volume volume-2beaec89-5a64-49bc-b479-f167dc05256d (2beaec89-5a64-49bc-b479-f167dc05256d): created successfully
Sep 10 19:33:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d782564-94c2-4789-a332-e9eb80beba6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Flow 'volume_create_manager' (2b9816bd-dd01-4131-9303-d96c50cbce5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:33:08 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4807e21c-5998-434a-a00f-8a4a9103d10d tempest-VolumesActionsTest-1357807624 None] Created volume successfully.
Sep 10 19:33:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Acquiring lock "cinder-2beaec89-5a64-49bc-b479-f167dc05256d-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:33:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Lock "cinder-2beaec89-5a64-49bc-b479-f167dc05256d-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:33:10 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:33:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Acquiring lock "cinder-quobyte-2beaec89-5a64-49bc-b479-f167dc05256d" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:33:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Lock "cinder-quobyte-2beaec89-5a64-49bc-b479-f167dc05256d" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:33:10 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c59ad9c-979a-456f-a496-49ec6e101cf8]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:33:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2beaec89-5a64-49bc-b479-f167dc05256d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2beaec89-5a64-49bc-b479-f167dc05256d" returned: 0 in 0.563s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2beaec89-5a64-49bc-b479-f167dc05256d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2beaec89-5a64-49bc-b479-f167dc05256d" returned: 0 in 0.176s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Lock "cinder-quobyte-2beaec89-5a64-49bc-b479-f167dc05256d" released by "delete_volume" :: held 0.978s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:33:11 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Created reservations ['9fffffe9-6d59-4abc-863a-21d7fa9654ca', 'b6f7f103-6a7a-44c5-9da5-c2332749f256', '8e78984c-6f2c-47ff-a462-181eaefc3321', 'eeb98257-3519-4a88-b8a6-4fe731b43e33'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:33:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:33:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:33:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.136s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:12 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:33:12 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Deleted volume successfully.
Sep 10 19:33:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-91c9fd75-a5f7-463c-8973-99e4c2c822c8 tempest-VolumesActionsTest-1425939557 None] Lock "cinder-2beaec89-5a64-49bc-b479-f167dc05256d-delete_volume" released by "delete_volume" :: held 3.270s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:33:13 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:33:13 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:33:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Flow 'volume_create_manager' (f9c1904d-8c8e-478c-8138-63a6ee42dfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:33:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b6c2ea-4dc7-4f9a-b871-baf9c0dc8a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:13 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:33:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:33:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:33:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b6c2ea-4dc7-4f9a-b871-baf9c0dc8a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-410417385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e640e98e37f4513bc8b7328ee0d10da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:33:13Z,use_quota=True,user_id='9ad7752bbcf34acf8562ff85a5a4e61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f2f262-d2a8-4b5b-aa0a-7d096a8e9ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f2f262-d2a8-4b5b-aa0a-7d096a8e9ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fc2bb6-77e4-4aa4-99ad-24906e74bd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fc2bb6-77e4-4aa4-99ad-24906e74bd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5', 'volume_name': 'volume-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251c22f5-412e-4c34-9919-b0e0b11f40c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251c22f5-412e-4c34-9919-b0e0b11f40c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2a5f29-45d7-42c3-b347-ba7e654d897c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:14 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Volume 0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5', 'volume_size': 1}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-410417385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e640e98e37f4513bc8b7328ee0d10da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:33:13Z,use_quota=True,user_id='9ad7752bbcf34acf8562ff85a5a4e61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Creating volume 0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:33:14 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.727s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:33:14 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=40, name=volume-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:33:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5 1073741824" returned: 0 in 0.630s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5" returned: 0 in 0.158s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] <== create_volume: return (888ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:33:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2a5f29-45d7-42c3-b347-ba7e654d897c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b99d36a-7c1c-4dbd-80d4-f197fc7c554c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:15 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Volume volume-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5 (0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5): created successfully
Sep 10 19:33:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b99d36a-7c1c-4dbd-80d4-f197fc7c554c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Flow 'volume_create_manager' (f9c1904d-8c8e-478c-8138-63a6ee42dfdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:33:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9671bea1-793b-4245-8879-5ad6ad123543 tempest-VolumesActionsTest-1357807624 None] Created volume successfully.
Sep 10 19:33:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Acquiring lock "cinder-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:33:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Lock "cinder-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:33:17 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:33:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Acquiring lock "cinder-quobyte-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:33:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Lock "cinder-quobyte-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:33:17 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c010effe-bc45-49dc-8104-ad4bff4b7424]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:33:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5" returned: 0 in 0.523s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5" returned: 0 in 0.141s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Lock "cinder-quobyte-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5" released by "delete_volume" :: held 1.015s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:33:18 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Created reservations ['78b1b9dd-2800-4744-9dff-8de0130b31f0', '3a32b60c-1b56-4fde-ab59-d8e1ce899002', '773409e5-38b3-43b1-a5e7-9ad99ffcf015', '68df778b-7845-41df-a050-711fe6754fa9'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:33:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:33:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:33:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.133s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:18 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:33:19 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Deleted volume successfully.
Sep 10 19:33:19 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-ced146a6-bdcd-4a17-a5e7-d8df8451f463 req-d0c1297c-2170-4714-a4f7-9a8e7ef73c0c tempest-AttachVolumeShelveTestJSON-254880779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:33:20 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-ced146a6-bdcd-4a17-a5e7-d8df8451f463 req-d0c1297c-2170-4714-a4f7-9a8e7ef73c0c tempest-AttachVolumeShelveTestJSON-254880779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:33:20 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-ced146a6-bdcd-4a17-a5e7-d8df8451f463 req-d0c1297c-2170-4714-a4f7-9a8e7ef73c0c tempest-AttachVolumeShelveTestJSON-254880779 None] Terminate volume connection completed successfully.
Sep 10 19:33:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-ced146a6-bdcd-4a17-a5e7-d8df8451f463 req-d0c1297c-2170-4714-a4f7-9a8e7ef73c0c tempest-AttachVolumeShelveTestJSON-254880779 None] Deleting attachment d1d85b7d-089d-4ef8-b527-da80225bb6f7. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:33:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-52cc21e8-ad8c-428a-b90f-12baeee09582 tempest-VolumesActionsTest-1425939557 None] Lock "cinder-0a6b737a-1cd4-4e6a-9aa3-85f552e9e1d5-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:33:21 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Flow 'volume_create_manager' (3fea728c-9775-49a3-88db-09183e1a6890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ee029b-1cf3-4008-9547-10dbdf317ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ee029b-1cf3-4008-9547-10dbdf317ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1777757053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653b8fe8-f580-4275-ac61-2026450b0ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e640e98e37f4513bc8b7328ee0d10da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:33:21Z,use_quota=True,user_id='9ad7752bbcf34acf8562ff85a5a4e61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7b00d9-66bd-4e7e-959e-3d1e8faaa0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7b00d9-66bd-4e7e-959e-3d1e8faaa0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ecc349-3143-4187-9d9c-2aa66dd435de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ecc349-3143-4187-9d9c-2aa66dd435de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '653b8fe8-f580-4275-ac61-2026450b0ad5', 'volume_name': 'volume-653b8fe8-f580-4275-ac61-2026450b0ad5', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0863375f-ed79-4966-91c5-05cd79ec6996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0863375f-ed79-4966-91c5-05cd79ec6996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2a7f9d-f4ff-4e4a-9b03-5f16490ab0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:21 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Volume 653b8fe8-f580-4275-ac61-2026450b0ad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-653b8fe8-f580-4275-ac61-2026450b0ad5', 'volume_size': 1}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1777757053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653b8fe8-f580-4275-ac61-2026450b0ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e640e98e37f4513bc8b7328ee0d10da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:33:21Z,use_quota=True,user_id='9ad7752bbcf34acf8562ff85a5a4e61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Creating volume 653b8fe8-f580-4275-ac61-2026450b0ad5 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:33:21 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:33:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-653b8fe8-f580-4275-ac61-2026450b0ad5 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:21 devstack quobyte-client[82855]: System call of process 90422 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:33:21 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=41, name=volume-653b8fe8-f580-4275-ac61-2026450b0ad5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:33:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-653b8fe8-f580-4275-ac61-2026450b0ad5 1073741824" returned: 0 in 0.776s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-653b8fe8-f580-4275-ac61-2026450b0ad5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-653b8fe8-f580-4275-ac61-2026450b0ad5" returned: 0 in 0.227s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] <== create_volume: return (1123ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:33:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2a7f9d-f4ff-4e4a-9b03-5f16490ab0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-653b8fe8-f580-4275-ac61-2026450b0ad5', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34f9726-78b5-4c7c-94aa-e24cc242e773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:23 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Volume volume-653b8fe8-f580-4275-ac61-2026450b0ad5 (653b8fe8-f580-4275-ac61-2026450b0ad5): created successfully
Sep 10 19:33:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34f9726-78b5-4c7c-94aa-e24cc242e773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Flow 'volume_create_manager' (3fea728c-9775-49a3-88db-09183e1a6890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:33:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cd2fd9a0-de3d-4470-8147-c2c2b6bf4917 tempest-VolumesActionsTest-1357807624 None] Created volume successfully.
Sep 10 19:33:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Acquiring lock "cinder-653b8fe8-f580-4275-ac61-2026450b0ad5-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:33:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Lock "cinder-653b8fe8-f580-4275-ac61-2026450b0ad5-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:33:26 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:33:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Acquiring lock "cinder-quobyte-653b8fe8-f580-4275-ac61-2026450b0ad5" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:33:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Lock "cinder-quobyte-653b8fe8-f580-4275-ac61-2026450b0ad5" acquired by "delete_volume" :: waited 0.030s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:33:26 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec227133-6d78-4aea-8a21-ec2eeefe590c]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:33:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-653b8fe8-f580-4275-ac61-2026450b0ad5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-653b8fe8-f580-4275-ac61-2026450b0ad5" returned: 0 in 0.801s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-653b8fe8-f580-4275-ac61-2026450b0ad5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-653b8fe8-f580-4275-ac61-2026450b0ad5" returned: 0 in 0.186s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Lock "cinder-quobyte-653b8fe8-f580-4275-ac61-2026450b0ad5" released by "delete_volume" :: held 1.286s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:33:27 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Created reservations ['fb4594d4-bde1-4d82-80c6-99fcef04efe6', '6e20ec6c-1267-44f9-a784-05d9ae25b7ca', 'c4c9b238-8b6c-472f-985d-2ec28f6c6743', '24147f11-5e12-4b89-b2fd-aaa6751f0377'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:33:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:33:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:33:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.248s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:29 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:33:29 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Deleted volume successfully.
Sep 10 19:33:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fa302972-98cf-4042-a1b3-1d65fa72a00a tempest-VolumesActionsTest-1425939557 None] Lock "cinder-653b8fe8-f580-4275-ac61-2026450b0ad5-delete_volume" released by "delete_volume" :: held 3.719s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:33:30 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:33:30 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:33:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Flow 'volume_create_manager' (752d0f68-d6c7-4513-ba8b-f5c7d8ca0c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:33:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7bbbd78-989c-4af9-ac23-f8f9f4eee945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7bbbd78-989c-4af9-ac23-f8f9f4eee945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1703185415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b947248-adcc-4820-9e09-9da3ab9733df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e640e98e37f4513bc8b7328ee0d10da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:33:31Z,use_quota=True,user_id='9ad7752bbcf34acf8562ff85a5a4e61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f578ab-e0a3-4028-b6a4-61e5d1914bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f578ab-e0a3-4028-b6a4-61e5d1914bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b78e43-0ef7-48a9-b130-367f2fdaecc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b78e43-0ef7-48a9-b130-367f2fdaecc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b947248-adcc-4820-9e09-9da3ab9733df', 'volume_name': 'volume-7b947248-adcc-4820-9e09-9da3ab9733df', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0189a5d-189d-4050-bc35-522536cfd5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0189a5d-189d-4050-bc35-522536cfd5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97efa59a-1a04-45d2-8c64-1db2e7b265b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:31 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Volume 7b947248-adcc-4820-9e09-9da3ab9733df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b947248-adcc-4820-9e09-9da3ab9733df', 'volume_size': 1}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1703185415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b947248-adcc-4820-9e09-9da3ab9733df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e640e98e37f4513bc8b7328ee0d10da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:33:31Z,use_quota=True,user_id='9ad7752bbcf34acf8562ff85a5a4e61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Creating volume 7b947248-adcc-4820-9e09-9da3ab9733df {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:33:31 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7b947248-adcc-4820-9e09-9da3ab9733df 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:31 devstack quobyte-client[82855]: System call of process 90476 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:33:31 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=42, name=volume-7b947248-adcc-4820-9e09-9da3ab9733df, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7b947248-adcc-4820-9e09-9da3ab9733df 1073741824" returned: 0 in 0.474s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7b947248-adcc-4820-9e09-9da3ab9733df {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7b947248-adcc-4820-9e09-9da3ab9733df" returned: 0 in 0.131s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] <== create_volume: return (678ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:33:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97efa59a-1a04-45d2-8c64-1db2e7b265b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b947248-adcc-4820-9e09-9da3ab9733df', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43976729-24e8-44f5-a1c1-6e4e203c444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:32 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Volume volume-7b947248-adcc-4820-9e09-9da3ab9733df (7b947248-adcc-4820-9e09-9da3ab9733df): created successfully
Sep 10 19:33:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43976729-24e8-44f5-a1c1-6e4e203c444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Flow 'volume_create_manager' (752d0f68-d6c7-4513-ba8b-f5c7d8ca0c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:33:32 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9d561804-1f90-47bc-aa8c-6e7b6c277f98 tempest-VolumesActionsTest-1357807624 None] Created volume successfully.
Sep 10 19:33:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Acquiring lock "cinder-7b947248-adcc-4820-9e09-9da3ab9733df-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:33:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Lock "cinder-7b947248-adcc-4820-9e09-9da3ab9733df-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:33:33 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:33:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Acquiring lock "cinder-quobyte-7b947248-adcc-4820-9e09-9da3ab9733df" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:33:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Lock "cinder-quobyte-7b947248-adcc-4820-9e09-9da3ab9733df" acquired by "delete_volume" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:33:34 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5ce8bc-d20b-4c67-b2c8-f7a0f306ba05]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:33:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7b947248-adcc-4820-9e09-9da3ab9733df {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7b947248-adcc-4820-9e09-9da3ab9733df" returned: 0 in 0.577s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7b947248-adcc-4820-9e09-9da3ab9733df {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-7b947248-adcc-4820-9e09-9da3ab9733df" returned: 0 in 0.180s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Lock "cinder-quobyte-7b947248-adcc-4820-9e09-9da3ab9733df" released by "delete_volume" :: held 0.995s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:33:35 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Created reservations ['5ced7ef0-36dc-473c-8e09-7eb71ba3a470', 'e107da5e-bb73-44a2-a660-f61e4e3203cf', '2e6ced3d-d4b4-44b7-9cd5-c9cc9976daa9', 'db345e1d-818e-4222-b034-3c992cb27f0e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:33:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:33:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:33:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.158s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:35 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:33:36 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Deleted volume successfully.
Sep 10 19:33:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-14e2559c-3e8f-47ad-89f4-84c5356fa458 tempest-VolumesActionsTest-1357807624 None] Lock "cinder-7b947248-adcc-4820-9e09-9da3ab9733df-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:33:45 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=25,cinder:UPDATE=52,cinder:DELETE=6,cinder:INSERT=10 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:33:46 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=38,cinder:UPDATE=49,cinder:INSERT=10,cinder:DELETE=4 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:33:58 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:33:58 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:33:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Flow 'volume_create_manager' (2422ba6f-6332-4d8b-90ba-e2cbf16b02ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:33:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835f137d-ebf1-420e-90ea-3e6795f6d58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835f137d-ebf1-420e-90ea-3e6795f6d58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-725554886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566bd151-20c2-4597-aaf5-9ea3b5d679fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4cfa037d6dc4ab8b3f31ef43684a06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:33:58Z,use_quota=True,user_id='a5d8b8e63df84f898ae4f7ad2834e249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be40d9e-8b4b-4333-87b6-19d16f62f3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be40d9e-8b4b-4333-87b6-19d16f62f3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d78c839-4c38-4a7d-b8ef-2754797de6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d78c839-4c38-4a7d-b8ef-2754797de6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '566bd151-20c2-4597-aaf5-9ea3b5d679fa', 'volume_name': 'volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa', 'volume_size': 1, 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '489167b5c946434eba8a26e1f48a2447', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'created_at': datetime.datetime(2025, 9, 10, 17, 8, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/391d42a7-95bd-4118-889d-f5820ea8d60f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc56e890e50>}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f2b6fc-74e5-4361-883e-82a19e91d544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f2b6fc-74e5-4361-883e-82a19e91d544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:33:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a7ebf0-7921-4f24-84e3-7893d617607a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:33:58 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Volume 566bd151-20c2-4597-aaf5-9ea3b5d679fa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa', 'volume_size': 1, 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '489167b5c946434eba8a26e1f48a2447', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'created_at': datetime.datetime(2025, 9, 10, 17, 8, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/391d42a7-95bd-4118-889d-f5820ea8d60f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc56e890e50>}
Sep 10 19:33:58 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Cloning 566bd151-20c2-4597-aaf5-9ea3b5d679fa from image 391d42a7-95bd-4118-889d-f5820ea8d60f  at location (None, None). {{(pid=82850) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 19:33:59 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_wdd2ikmfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 19:33:59 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Image download 20.69 MB at 20.69 MB/s
Sep 10 19:33:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4683d900-cd44-4d99-a92e-64c7925f9572]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:33:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_wdd2ikmfdevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:00 devstack sudo[90598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_wdd2ikmfdevstack@QuobyteHD
Sep 10 19:34:00 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:34:05 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root
Sep 10 19:34:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_wdd2ikmfdevstack@QuobyteHD" returned: 0 in 6.241s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:05 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Temporary image 391d42a7-95bd-4118-889d-f5820ea8d60f is fetched for user a5d8b8e63df84f898ae4f7ad2834e249. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 19:34:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[205ac9ab-1296-49a3-adea-b0bea1a02065]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:34:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_wdd2ikmfdevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:07 devstack sudo[90677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_wdd2ikmfdevstack@QuobyteHD
Sep 10 19:34:07 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:34:08 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:34:10 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root
Sep 10 19:34:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_wdd2ikmfdevstack@QuobyteHD" returned: 0 in 3.689s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-725554886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566bd151-20c2-4597-aaf5-9ea3b5d679fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4cfa037d6dc4ab8b3f31ef43684a06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:33:58Z,use_quota=True,user_id='a5d8b8e63df84f898ae4f7ad2834e249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:34:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Creating volume 566bd151-20c2-4597-aaf5-9ea3b5d679fa {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:34:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:34:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:34:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:34:10 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:34:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:10 devstack quobyte-client[82855]: System call of process 90691 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:34:10 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=43, name=volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:34:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa 1073741824" returned: 0 in 0.748s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa" returned: 0 in 0.405s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] <== create_volume: return (1353ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:34:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:12 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Attempting download of 391d42a7-95bd-4118-889d-f5820ea8d60f ((None, None)) to volume 566bd151-20c2-4597-aaf5-9ea3b5d679fa. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 19:34:12 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[09016816-8359-4582-a031-458d4fbd3fd5]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:34:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_0t5rwkku {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_0t5rwkku" returned: 0 in 1.137s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_0t5rwkku {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:34:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.035s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:34:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:34:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.075s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.346s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:34:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_0t5rwkku" returned: 1 in 1.283s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_0t5rwkku' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:34:15 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc921f09-ec26-45ca-bbd2-c8462c64d356]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:34:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_wdd2ikmfdevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_wdd2ikmfdevstack@QuobyteHD" returned: 0 in 2.009s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:17 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] 391d42a7-95bd-4118-889d-f5820ea8d60f was qcow2, converting to raw {{(pid=82850) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 19:34:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_wdd2ikmfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:17 devstack quobyte-client[82855]: System call of process 90719 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:34:17 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=43, name=volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:34:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_wdd2ikmfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa" returned: 0 in 3.003s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:20 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_wdd2ikmfdevstack@QuobyteHD, size 112.00 MB, duration 3.09 sec, destination /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:34:20 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Converted 112.00 MB image at 36.23 MB/s
Sep 10 19:34:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:20 devstack quobyte-client[82855]: System call of process 90735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:34:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa 1G" returned: 0 in 0.955s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:21 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:21 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:34:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Flow 'volume_create_manager' (394bd6b0-4080-4177-9150-5fb62e01d03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:34:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709b8c59-50ff-4192-81ef-c3695a645ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:21 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3142e58d-6c48-4922-b6cb-819038d38e9d]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:34:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709b8c59-50ff-4192-81ef-c3695a645ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-558124096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2aac06-976c-4587-aaf3-7f8ed5656bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e41cd269a9444c69db58e830bf56ca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:34:21Z,use_quota=True,user_id='24926c90844a4da8a5295a9d3c646c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2944dad0-8656-4cfc-95b3-1e1ebf4deeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2944dad0-8656-4cfc-95b3-1e1ebf4deeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e963577f-b466-459b-84b0-16ed4ef867a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e963577f-b466-459b-84b0-16ed4ef867a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a2aac06-976c-4587-aaf3-7f8ed5656bb2', 'volume_name': 'volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b9f53b-ab74-4e94-91a7-f29efb150a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b9f53b-ab74-4e94-91a7-f29efb150a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2971189d-622f-453b-86b6-a6cf8de3445c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:22 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Volume 3a2aac06-976c-4587-aaf3-7f8ed5656bb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2', 'volume_size': 1}
Sep 10 19:34:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-558124096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2aac06-976c-4587-aaf3-7f8ed5656bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e41cd269a9444c69db58e830bf56ca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:34:21Z,use_quota=True,user_id='24926c90844a4da8a5295a9d3c646c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:34:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Creating volume 3a2aac06-976c-4587-aaf3-7f8ed5656bb2 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:34:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:34:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:34:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:34:23 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:34:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:23 devstack quobyte-client[82855]: System call of process 90738 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:34:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa" returned: 0 in 1.323s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:23 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=44, name=volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:34:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2 1073741824" returned: 0 in 1.019s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2" returned: 0 in 0.204s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] <== create_volume: return (1387ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:34:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:24 devstack quobyte-client[82855]: System call of process 90743 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:34:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa" returned: 1 in 1.704s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:34:25 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Downloaded image 391d42a7-95bd-4118-889d-f5820ea8d60f ((None, None)) to volume 566bd151-20c2-4597-aaf5-9ea3b5d679fa successfully. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 19:34:25 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Temporary image 391d42a7-95bd-4118-889d-f5820ea8d60f for user a5d8b8e63df84f898ae4f7ad2834e249 is deleted. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 19:34:25 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Marking volume 566bd151-20c2-4597-aaf5-9ea3b5d679fa as bootable. {{(pid=82850) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 19:34:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2971189d-622f-453b-86b6-a6cf8de3445c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64357d08-53ff-4e8e-a79c-6c16b46e3fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:25 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Volume volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2 (3a2aac06-976c-4587-aaf3-7f8ed5656bb2): created successfully
Sep 10 19:34:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64357d08-53ff-4e8e-a79c-6c16b46e3fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Flow 'volume_create_manager' (394bd6b0-4080-4177-9150-5fb62e01d03f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:34:25 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Copying metadata from image 391d42a7-95bd-4118-889d-f5820ea8d60f to 566bd151-20c2-4597-aaf5-9ea3b5d679fa. {{(pid=82850) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 19:34:25 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Creating volume glance metadata for volume 566bd151-20c2-4597-aaf5-9ea3b5d679fa backed by image 391d42a7-95bd-4118-889d-f5820ea8d60f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82850) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 19:34:25 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-684b4d16-2d5f-438a-9943-e8a295778382 tempest-AttachVolumeNegativeTest-1515327604 None] Created volume successfully.
Sep 10 19:34:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a7ebf0-7921-4f24-84e3-7893d617607a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa', 'volume_size': 1, 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '489167b5c946434eba8a26e1f48a2447', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'created_at': datetime.datetime(2025, 9, 10, 17, 8, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/391d42a7-95bd-4118-889d-f5820ea8d60f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc56e890e50>}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1b8eb9-4cf8-4b1f-84b0-71074a8077b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:25 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Volume volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa (566bd151-20c2-4597-aaf5-9ea3b5d679fa): created successfully
Sep 10 19:34:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1b8eb9-4cf8-4b1f-84b0-71074a8077b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Flow 'volume_create_manager' (2422ba6f-6332-4d8b-90ba-e2cbf16b02ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:34:25 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-475252e8-75f2-46ab-a929-eac12d669377 tempest-VolumesImageMetadata-1015436466 None] Created volume successfully.
Sep 10 19:34:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Acquiring lock "cinder-566bd151-20c2-4597-aaf5-9ea3b5d679fa-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:34:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Lock "cinder-566bd151-20c2-4597-aaf5-9ea3b5d679fa-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:34:27 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Acquiring lock "cinder-quobyte-566bd151-20c2-4597-aaf5-9ea3b5d679fa" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:34:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Lock "cinder-quobyte-566bd151-20c2-4597-aaf5-9ea3b5d679fa" acquired by "delete_volume" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:34:27 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[501f5c6e-c41e-4e28-83cd-1f3a9b93cd5b]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:34:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa" returned: 0 in 0.419s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa" returned: 1 in 0.422s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:34:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-566bd151-20c2-4597-aaf5-9ea3b5d679fa" returned: 0 in 0.110s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Lock "cinder-quobyte-566bd151-20c2-4597-aaf5-9ea3b5d679fa" released by "delete_volume" :: held 1.172s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:34:28 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Created reservations ['8aaeaeb7-8259-490a-969e-b407b861d009', '8d837f8c-8c51-4b20-b707-5d7767c42c23', '6cbfb1be-cde0-4d3d-a2b5-d96a1d98b828', 'c9def261-071c-436e-8164-f1156211f3c4'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:34:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:34:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:34:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.184s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:29 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:34:29 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Deleted volume successfully.
Sep 10 19:34:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-15a66ec9-adbb-46a2-b831-d3f782aa5e6a tempest-VolumesImageMetadata-1015436466 None] Lock "cinder-566bd151-20c2-4597-aaf5-9ea3b5d679fa-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:34:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-084cf0ad-5e4c-4747-92a3-4f5753773ae8 req-44c8959a-55ba-417c-89a4-92d5d5be4c5b tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-084cf0ad-5e4c-4747-92a3-4f5753773ae8 req-44c8959a-55ba-417c-89a4-92d5d5be4c5b tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:31 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd7e33b-1b32-45db-b494-0d06c79ade95]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:34:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-084cf0ad-5e4c-4747-92a3-4f5753773ae8 req-44c8959a-55ba-417c-89a4-92d5d5be4c5b tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-084cf0ad-5e4c-4747-92a3-4f5753773ae8 req-44c8959a-55ba-417c-89a4-92d5d5be4c5b tempest-AttachVolumeNegativeTest-1515327604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2" returned: 0 in 0.793s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-084cf0ad-5e4c-4747-92a3-4f5753773ae8 req-44c8959a-55ba-417c-89a4-92d5d5be4c5b tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.907s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-084cf0ad-5e4c-4747-92a3-4f5753773ae8 req-44c8959a-55ba-417c-89a4-92d5d5be4c5b tempest-AttachVolumeNegativeTest-1515327604 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2e66239-bd92-4800-b715-a4b323c7642d', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:34:32 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-084cf0ad-5e4c-4747-92a3-4f5753773ae8 req-44c8959a-55ba-417c-89a4-92d5d5be4c5b tempest-AttachVolumeNegativeTest-1515327604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:32 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-084cf0ad-5e4c-4747-92a3-4f5753773ae8 req-44c8959a-55ba-417c-89a4-92d5d5be4c5b tempest-AttachVolumeNegativeTest-1515327604 None] attachment_update completed successfully.
Sep 10 19:34:34 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:34 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:34:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Flow 'volume_create_manager' (98903d11-6d6e-48e4-ae49-da792ff8b328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:34:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84569098-ac34-47c5-8e6d-3ced74581790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84569098-ac34-47c5-8e6d-3ced74581790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-553440179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb20537-df06-40da-9e50-74006c361f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fe052b195547f29ae34b753ee3403f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:34:35Z,use_quota=True,user_id='b3099c30bb5f4d6183d11993e93d1ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc9c718-89dd-46b9-86ac-0604a489c33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc9c718-89dd-46b9-86ac-0604a489c33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f323ccd-2e8d-4e3a-b4ff-67f8aed67b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f323ccd-2e8d-4e3a-b4ff-67f8aed67b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fb20537-df06-40da-9e50-74006c361f07', 'volume_name': 'volume-5fb20537-df06-40da-9e50-74006c361f07', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9dda7a-bc93-47bd-b7cd-e72e8aa957ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9dda7a-bc93-47bd-b7cd-e72e8aa957ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (240dbf69-1c79-44e7-b96b-6fbc2d28f1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:35 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Volume 5fb20537-df06-40da-9e50-74006c361f07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fb20537-df06-40da-9e50-74006c361f07', 'volume_size': 1}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-553440179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb20537-df06-40da-9e50-74006c361f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fe052b195547f29ae34b753ee3403f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:34:35Z,use_quota=True,user_id='b3099c30bb5f4d6183d11993e93d1ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Creating volume 5fb20537-df06-40da-9e50-74006c361f07 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:34:35 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:35 devstack quobyte-client[82855]: System call of process 91117 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:34:35 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=45, name=volume-5fb20537-df06-40da-9e50-74006c361f07, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07 1073741824" returned: 0 in 0.539s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07" returned: 0 in 0.291s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] <== create_volume: return (945ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:34:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (240dbf69-1c79-44e7-b96b-6fbc2d28f1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fb20537-df06-40da-9e50-74006c361f07', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13724cf9-5f57-45f2-870b-8a1977c48f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:36 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Volume volume-5fb20537-df06-40da-9e50-74006c361f07 (5fb20537-df06-40da-9e50-74006c361f07): created successfully
Sep 10 19:34:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13724cf9-5f57-45f2-870b-8a1977c48f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Flow 'volume_create_manager' (98903d11-6d6e-48e4-ae49-da792ff8b328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:34:36 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0e103080-f605-4334-a91a-0e11a3775949 tempest-SnapshotMetadataTestJSON-25643258 None] Created volume successfully.
Sep 10 19:34:37 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] Creating offline snapshot 27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd of volume 5fb20537-df06-40da-9e50-74006c361f07 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:34:37 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3957b8d4-6db7-4b6b-929d-f1d1be8c7d1c]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:34:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07" returned: 0 in 0.463s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:38 devstack quobyte-client[82855]: System call of process 91163 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:34:38 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=46, name=volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:34:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd 1G" returned: 0 in 0.313s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5fb20537-df06-40da-9e50-74006c361f07 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:38 devstack quobyte-client[82855]: System call of process 91166 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:34:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] CMD "qemu-img rebase -u -b volume-5fb20537-df06-40da-9e50-74006c361f07 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd" returned: 0 in 0.191s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:34:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd" returned: 0 in 0.166s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:34:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd" returned: 0 in 0.082s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.info" returned: 0 in 0.098s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:34:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.info" returned: 0 in 0.097s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.765s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:39 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9754034d-fd2c-409f-9000-64454c1ac4d8 tempest-SnapshotMetadataTestJSON-25643258 None] Create snapshot completed successfully
Sep 10 19:34:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Acquiring lock "cinder-27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:34:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Lock "cinder-27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:34:41 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Acquiring lock "cinder-quobyte-5fb20537-df06-40da-9e50-74006c361f07" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:34:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Lock "cinder-quobyte-5fb20537-df06-40da-9e50-74006c361f07" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:34:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Acquiring lock "cinder-quobyte-27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:34:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Lock "cinder-quobyte-27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:34:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Deleting offline snapshot 27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd of volume 5fb20537-df06-40da-9e50-74006c361f07 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:34:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] snapshot_file for this snap is: volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:34:41 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[328bd5fa-43b9-4e9e-b0a7-50d3806ae916]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:34:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd" returned: 0 in 0.533s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fb20537-df06-40da-9e50-74006c361f07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:34:42 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6a4c21-d8af-4c8d-833f-db8dac36f8a4]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:34:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:42 devstack quobyte-client[82855]: System call of process 91181 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:34:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07" returned: 0 in 0.450s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd" returned: 0 in 0.212s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07.27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd" returned: 0 in 0.085s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Lock "cinder-quobyte-27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd" released by "_delete_snapshot" :: held 1.638s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:34:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Lock "cinder-quobyte-5fb20537-df06-40da-9e50-74006c361f07" released by "delete_snapshot" :: held 1.670s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:34:43 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Created reservations ['27b43faf-ba9a-4481-9bce-f6c1591eedb9', '4c8995c0-f1e5-4f05-b8e6-ce2643d987ac', 'd0ae2f82-a869-4ae5-b217-312fca47952b', 'f95d061f-c95c-4cec-ad53-7cf2b6dc6954'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:34:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Delete snapshot completed successfully.
Sep 10 19:34:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f943ff19-f25a-4f9d-8c34-dd1929084c23 tempest-SnapshotMetadataTestJSON-25643258 None] Lock "cinder-27fcba36-c6b3-4ce7-b9b2-64c7aa0e08fd-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:34:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Acquiring lock "cinder-5fb20537-df06-40da-9e50-74006c361f07-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:34:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Lock "cinder-5fb20537-df06-40da-9e50-74006c361f07-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:34:45 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Acquiring lock "cinder-quobyte-5fb20537-df06-40da-9e50-74006c361f07" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:34:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Lock "cinder-quobyte-5fb20537-df06-40da-9e50-74006c361f07" acquired by "delete_volume" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:34:45 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bbfa57-301e-4b3b-beee-a540c12e2099]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:34:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07" returned: 0 in 0.584s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5fb20537-df06-40da-9e50-74006c361f07" returned: 0 in 0.093s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Lock "cinder-quobyte-5fb20537-df06-40da-9e50-74006c361f07" released by "delete_volume" :: held 0.862s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:34:46 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Created reservations ['afd0be46-c940-47e5-891d-b764b2ee0000', '6d41ee2d-fde6-4930-a831-03b0ca0e73f1', 'e62b7e6b-7805-4d74-aaf8-9a782fddf334', '1fade1cc-3593-4a8e-a27c-cbb740b9ebf6'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:34:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:34:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:34:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.083s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:46 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:34:46 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Deleted volume successfully.
Sep 10 19:34:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-86e064b4-803a-4893-ba85-64b372d0d48f tempest-SnapshotMetadataTestJSON-25643258 None] Lock "cinder-5fb20537-df06-40da-9e50-74006c361f07-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:34:51 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Flow 'volume_create_manager' (f99e418d-b01e-492d-befc-353c1f5a3a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07724f5c-7260-4cf0-a344-601f4d3b93d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07724f5c-7260-4cf0-a344-601f4d3b93d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1344564188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a3d7f8-952f-4d44-b35a-86fc18cd36ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd65a1e4434b4241ad711caf1b554b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:34:52Z,use_quota=True,user_id='0245d0de825f431082daa692d9cc58f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfb1607-c8e1-4d39-97a2-b4858f59b07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfb1607-c8e1-4d39-97a2-b4858f59b07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96102887-ddb1-4d72-add4-3808c7ded6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96102887-ddb1-4d72-add4-3808c7ded6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a3d7f8-952f-4d44-b35a-86fc18cd36ef', 'volume_name': 'volume-24a3d7f8-952f-4d44-b35a-86fc18cd36ef', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66d828a-a9c7-4df9-ae15-7745ef6ff4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66d828a-a9c7-4df9-ae15-7745ef6ff4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba26b5e-b71a-4872-84dc-f43a301ab697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:52 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Volume 24a3d7f8-952f-4d44-b35a-86fc18cd36ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a3d7f8-952f-4d44-b35a-86fc18cd36ef', 'volume_size': 1}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1344564188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a3d7f8-952f-4d44-b35a-86fc18cd36ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd65a1e4434b4241ad711caf1b554b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:34:52Z,use_quota=True,user_id='0245d0de825f431082daa692d9cc58f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Creating volume 24a3d7f8-952f-4d44-b35a-86fc18cd36ef {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:34:52 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-24a3d7f8-952f-4d44-b35a-86fc18cd36ef 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:52 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=48, name=volume-24a3d7f8-952f-4d44-b35a-86fc18cd36ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-24a3d7f8-952f-4d44-b35a-86fc18cd36ef 1073741824" returned: 0 in 0.368s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-24a3d7f8-952f-4d44-b35a-86fc18cd36ef {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-24a3d7f8-952f-4d44-b35a-86fc18cd36ef" returned: 0 in 0.085s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] <== create_volume: return (520ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.534s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba26b5e-b71a-4872-84dc-f43a301ab697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a3d7f8-952f-4d44-b35a-86fc18cd36ef', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe66496d-51e0-4c28-87f3-52e0eb3c3423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:52 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Volume volume-24a3d7f8-952f-4d44-b35a-86fc18cd36ef (24a3d7f8-952f-4d44-b35a-86fc18cd36ef): created successfully
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe66496d-51e0-4c28-87f3-52e0eb3c3423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Flow 'volume_create_manager' (f99e418d-b01e-492d-befc-353c1f5a3a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:34:53 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c8160d1a-a303-4b10-8078-8f955677b1ab tempest-AbsoluteLimitsTests-2107846303 None] Created volume successfully.
Sep 10 19:34:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Acquiring lock "cinder-24a3d7f8-952f-4d44-b35a-86fc18cd36ef-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:34:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Lock "cinder-24a3d7f8-952f-4d44-b35a-86fc18cd36ef-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:34:54 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Acquiring lock "cinder-quobyte-24a3d7f8-952f-4d44-b35a-86fc18cd36ef" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:34:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Lock "cinder-quobyte-24a3d7f8-952f-4d44-b35a-86fc18cd36ef" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:34:54 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d32c6b-dd29-436d-a950-ff9be9e029a7]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:34:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-24a3d7f8-952f-4d44-b35a-86fc18cd36ef {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-24a3d7f8-952f-4d44-b35a-86fc18cd36ef" returned: 0 in 0.457s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-24a3d7f8-952f-4d44-b35a-86fc18cd36ef {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-24a3d7f8-952f-4d44-b35a-86fc18cd36ef" returned: 0 in 0.088s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Lock "cinder-quobyte-24a3d7f8-952f-4d44-b35a-86fc18cd36ef" released by "delete_volume" :: held 0.698s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:34:55 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Created reservations ['80786982-8801-4dc5-b5bc-88a2a74ab229', '14d2f188-e277-4ce1-bea1-b62224d09a26', '7e15f2a5-46a8-4c5c-a005-755a5930aec3', '44f51c95-eb33-4701-9f12-1a0766b20f5e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:34:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:34:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:34:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.080s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:55 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:34:55 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Deleted volume successfully.
Sep 10 19:34:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-36ef0eab-f26c-4356-aa54-1fa3e43c5007 tempest-AbsoluteLimitsTests-2107846303 None] Lock "cinder-24a3d7f8-952f-4d44-b35a-86fc18cd36ef-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-33a97fa4-4334-4b7b-9e48-735c270fc255 req-af4d9364-3463-4c22-a549-8666304baab3 tempest-AttachVolumeNegativeTest-1515327604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:02 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=45,cinder:SELECT=36,cinder:INSERT=10,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:35:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-33a97fa4-4334-4b7b-9e48-735c270fc255 req-af4d9364-3463-4c22-a549-8666304baab3 tempest-AttachVolumeNegativeTest-1515327604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:02 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-33a97fa4-4334-4b7b-9e48-735c270fc255 req-af4d9364-3463-4c22-a549-8666304baab3 tempest-AttachVolumeNegativeTest-1515327604 None] Terminate volume connection completed successfully.
Sep 10 19:35:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-33a97fa4-4334-4b7b-9e48-735c270fc255 req-af4d9364-3463-4c22-a549-8666304baab3 tempest-AttachVolumeNegativeTest-1515327604 None] Deleting attachment d2e66239-bd92-4800-b715-a4b323c7642d. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:35:03 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:03 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Flow 'volume_create_manager' (05a0b98a-0b44-46b6-b2aa-7fa2c230a488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32341500-aa12-4db3-a0a8-2528659ba2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32341500-aa12-4db3-a0a8-2528659ba2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1726046549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5ba441-b43e-488f-a227-2da9351980c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e96558551824f66886647d308f4cd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:04Z,use_quota=True,user_id='58a86f6a7c90452e911a0e9c3186cc09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08788fb9-08e1-4bf0-9cbd-5bd4944a1d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08788fb9-08e1-4bf0-9cbd-5bd4944a1d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a7613b-b260-48b7-a299-145b5738b706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a7613b-b260-48b7-a299-145b5738b706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd5ba441-b43e-488f-a227-2da9351980c8', 'volume_name': 'volume-bd5ba441-b43e-488f-a227-2da9351980c8', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939dfcd4-41aa-46f8-991c-a015a455627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939dfcd4-41aa-46f8-991c-a015a455627b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d69242-ae27-4b94-8ff9-8f0c313d9bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:04 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Volume bd5ba441-b43e-488f-a227-2da9351980c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd5ba441-b43e-488f-a227-2da9351980c8', 'volume_size': 1}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1726046549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5ba441-b43e-488f-a227-2da9351980c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e96558551824f66886647d308f4cd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:04Z,use_quota=True,user_id='58a86f6a7c90452e911a0e9c3186cc09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Creating volume bd5ba441-b43e-488f-a227-2da9351980c8 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:35:04 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bd5ba441-b43e-488f-a227-2da9351980c8 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:04 devstack quobyte-client[82855]: System call of process 91305 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:35:04 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=49, name=volume-bd5ba441-b43e-488f-a227-2da9351980c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bd5ba441-b43e-488f-a227-2da9351980c8 1073741824" returned: 0 in 0.399s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bd5ba441-b43e-488f-a227-2da9351980c8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bd5ba441-b43e-488f-a227-2da9351980c8" returned: 0 in 0.120s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] <== create_volume: return (632ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:35:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.645s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d69242-ae27-4b94-8ff9-8f0c313d9bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd5ba441-b43e-488f-a227-2da9351980c8', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b7e9d1-83a6-4111-8664-8013f90b8662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:05 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Volume volume-bd5ba441-b43e-488f-a227-2da9351980c8 (bd5ba441-b43e-488f-a227-2da9351980c8): created successfully
Sep 10 19:35:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b7e9d1-83a6-4111-8664-8013f90b8662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Flow 'volume_create_manager' (05a0b98a-0b44-46b6-b2aa-7fa2c230a488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5d4b4cca-2c08-4642-9d96-4dc74ae5d492 tempest-VolumesTransfersTest-720925041 None] Created volume successfully.
Sep 10 19:35:08 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-2f3b47ab-f4de-407e-bc10-077dd3ad7978 tempest-VolumesTransfersTest-912143633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:08 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=41,cinder:SELECT=41,cinder:INSERT=19,cinder:DELETE=7 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:35:08 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2f3b47ab-f4de-407e-bc10-077dd3ad7978 tempest-VolumesTransfersTest-912143633 None] Transfer volume completed successfully.
Sep 10 19:35:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Acquiring lock "cinder-bd5ba441-b43e-488f-a227-2da9351980c8-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Lock "cinder-bd5ba441-b43e-488f-a227-2da9351980c8-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:10 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Acquiring lock "cinder-quobyte-bd5ba441-b43e-488f-a227-2da9351980c8" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Lock "cinder-quobyte-bd5ba441-b43e-488f-a227-2da9351980c8" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:10 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d4ef0a-2745-4979-a1cf-32707c4825d4]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bd5ba441-b43e-488f-a227-2da9351980c8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bd5ba441-b43e-488f-a227-2da9351980c8" returned: 0 in 1.081s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bd5ba441-b43e-488f-a227-2da9351980c8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bd5ba441-b43e-488f-a227-2da9351980c8" returned: 0 in 0.220s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Lock "cinder-quobyte-bd5ba441-b43e-488f-a227-2da9351980c8" released by "delete_volume" :: held 1.645s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:13 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Created reservations ['f664d7f7-dd42-41d0-aaf6-5bc077f2307d', '2f8b6328-5d9e-4a37-bcc7-301adf3b9bbf', 'd6e5c656-ac41-4cc3-b48b-a501e4a86529', '8709b0b2-0548-4b92-a2bc-49636c6bff34'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:35:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.174s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:13 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:13 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Deleted volume successfully.
Sep 10 19:35:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c6ad14de-0226-45fd-84ee-e4e5bcc462b4 tempest-VolumesTransfersTest-50974357 None] Lock "cinder-bd5ba441-b43e-488f-a227-2da9351980c8-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:13 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:35:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.130s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:14 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Flow 'volume_create_manager' (622558c2-1e72-4088-89b4-888155f1ccc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373b7b06-62d5-44a9-b59f-71500ace0e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373b7b06-62d5-44a9-b59f-71500ace0e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1648325355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f85372-6447-4d57-8b33-aaca2ad0aca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e96558551824f66886647d308f4cd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:15Z,use_quota=True,user_id='58a86f6a7c90452e911a0e9c3186cc09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a6a4d2-1c13-49b2-b10d-9af116979379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a6a4d2-1c13-49b2-b10d-9af116979379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17529cc-0be4-4bab-b63e-f41e2541916c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17529cc-0be4-4bab-b63e-f41e2541916c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5f85372-6447-4d57-8b33-aaca2ad0aca3', 'volume_name': 'volume-f5f85372-6447-4d57-8b33-aaca2ad0aca3', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb984b7-8294-4917-9584-198da4c4fdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb984b7-8294-4917-9584-198da4c4fdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6b5170-aec3-4599-9e71-65bfff89e872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:15 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Volume f5f85372-6447-4d57-8b33-aaca2ad0aca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5f85372-6447-4d57-8b33-aaca2ad0aca3', 'volume_size': 1}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1648325355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f85372-6447-4d57-8b33-aaca2ad0aca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e96558551824f66886647d308f4cd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:15Z,use_quota=True,user_id='58a86f6a7c90452e911a0e9c3186cc09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Creating volume f5f85372-6447-4d57-8b33-aaca2ad0aca3 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:35:15 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:35:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f5f85372-6447-4d57-8b33-aaca2ad0aca3 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:15 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=50, name=volume-f5f85372-6447-4d57-8b33-aaca2ad0aca3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:35:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f5f85372-6447-4d57-8b33-aaca2ad0aca3 1073741824" returned: 0 in 0.641s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f5f85372-6447-4d57-8b33-aaca2ad0aca3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f5f85372-6447-4d57-8b33-aaca2ad0aca3" returned: 0 in 0.105s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] <== create_volume: return (852ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:35:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6b5170-aec3-4599-9e71-65bfff89e872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f85372-6447-4d57-8b33-aaca2ad0aca3', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bb2db5-c33b-4663-814c-c550d142aa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Volume volume-f5f85372-6447-4d57-8b33-aaca2ad0aca3 (f5f85372-6447-4d57-8b33-aaca2ad0aca3): created successfully
Sep 10 19:35:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bb2db5-c33b-4663-814c-c550d142aa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Flow 'volume_create_manager' (622558c2-1e72-4088-89b4-888155f1ccc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-539e1d1d-db3a-4e5d-9b00-934bb570f03b tempest-VolumesTransfersTest-720925041 None] Created volume successfully.
Sep 10 19:35:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Acquiring lock "cinder-f5f85372-6447-4d57-8b33-aaca2ad0aca3-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Lock "cinder-f5f85372-6447-4d57-8b33-aaca2ad0aca3-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:17 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Acquiring lock "cinder-quobyte-f5f85372-6447-4d57-8b33-aaca2ad0aca3" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Lock "cinder-quobyte-f5f85372-6447-4d57-8b33-aaca2ad0aca3" acquired by "delete_volume" :: waited 0.034s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:17 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2224abb-5306-4df2-95b6-fc3ba9a92576]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f5f85372-6447-4d57-8b33-aaca2ad0aca3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:18 devstack quobyte-client[82855]: System call of process 91379 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:35:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f5f85372-6447-4d57-8b33-aaca2ad0aca3" returned: 0 in 1.071s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f5f85372-6447-4d57-8b33-aaca2ad0aca3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f5f85372-6447-4d57-8b33-aaca2ad0aca3" returned: 0 in 0.243s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Lock "cinder-quobyte-f5f85372-6447-4d57-8b33-aaca2ad0aca3" released by "delete_volume" :: held 1.661s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:20 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Created reservations ['9475188b-a9fe-4d1f-b073-f9c6e72ce57e', '844df479-eb39-44e9-a750-ee2a62d66141', 'ac919fe5-8fe6-4b49-b5a5-4a50bf1b022a', 'ec70dac4-c0de-4b89-a325-c216144e01c1'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:35:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.262s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:21 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:21 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Deleted volume successfully.
Sep 10 19:35:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0bdf03a0-5d0f-4769-8d52-b62d2a67785a tempest-VolumesTransfersTest-50974357 None] Lock "cinder-f5f85372-6447-4d57-8b33-aaca2ad0aca3-delete_volume" released by "delete_volume" :: held 5.152s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "cinder-3a2aac06-976c-4587-aaf3-7f8ed5656bb2-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:22 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:22 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Flow 'volume_create_manager' (86f7417a-9f48-413d-9822-1ae9260167b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe8eef6-2bdd-4673-a7be-9ba1f45583ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe8eef6-2bdd-4673-a7be-9ba1f45583ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-770299247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469505d4-e82d-41fa-b5eb-0c776c8fc3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88f5c19b42343eba62fe91e071f5d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:22Z,use_quota=True,user_id='7ca1baeecde94105b2e77a97bc354a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc09121-c29a-45f5-8bd2-623a1018f5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc09121-c29a-45f5-8bd2-623a1018f5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bed7777-34b4-4e42-a87c-2e3016f73921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bed7777-34b4-4e42-a87c-2e3016f73921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '469505d4-e82d-41fa-b5eb-0c776c8fc3f2', 'volume_name': 'volume-469505d4-e82d-41fa-b5eb-0c776c8fc3f2', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee64bb9-8eb5-474f-ac35-fee93a5ecd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee64bb9-8eb5-474f-ac35-fee93a5ecd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d6c7ac-def2-4cd1-8258-93eefc4782a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:23 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Volume 469505d4-e82d-41fa-b5eb-0c776c8fc3f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-469505d4-e82d-41fa-b5eb-0c776c8fc3f2', 'volume_size': 1}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-770299247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469505d4-e82d-41fa-b5eb-0c776c8fc3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88f5c19b42343eba62fe91e071f5d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:22Z,use_quota=True,user_id='7ca1baeecde94105b2e77a97bc354a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Creating volume 469505d4-e82d-41fa-b5eb-0c776c8fc3f2 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:35:23 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-469505d4-e82d-41fa-b5eb-0c776c8fc3f2 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "cinder-3a2aac06-976c-4587-aaf3-7f8ed5656bb2-delete_volume" acquired by "delete_volume" :: waited 0.447s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:23 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=51, name=volume-469505d4-e82d-41fa-b5eb-0c776c8fc3f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:35:23 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "cinder-quobyte-3a2aac06-976c-4587-aaf3-7f8ed5656bb2" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-469505d4-e82d-41fa-b5eb-0c776c8fc3f2 1073741824" returned: 0 in 1.030s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-469505d4-e82d-41fa-b5eb-0c776c8fc3f2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "cinder-quobyte-3a2aac06-976c-4587-aaf3-7f8ed5656bb2" acquired by "delete_volume" :: waited 0.410s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:24 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3e12d2-808c-43f7-b342-3939205fb35b]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-469505d4-e82d-41fa-b5eb-0c776c8fc3f2" returned: 0 in 0.413s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] <== create_volume: return (1538ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:35:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d6c7ac-def2-4cd1-8258-93eefc4782a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469505d4-e82d-41fa-b5eb-0c776c8fc3f2', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88eda7e8-be8a-4239-a90d-9409f1999a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:25 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Volume volume-469505d4-e82d-41fa-b5eb-0c776c8fc3f2 (469505d4-e82d-41fa-b5eb-0c776c8fc3f2): created successfully
Sep 10 19:35:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88eda7e8-be8a-4239-a90d-9409f1999a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Flow 'volume_create_manager' (86f7417a-9f48-413d-9822-1ae9260167b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:25 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b1129f15-6da4-4986-97af-bd56a53ea524 tempest-AttachVolumeShelveTestJSON-254880779 None] Created volume successfully.
Sep 10 19:35:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2" returned: 0 in 0.861s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3a2aac06-976c-4587-aaf3-7f8ed5656bb2" returned: 0 in 0.115s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "cinder-quobyte-3a2aac06-976c-4587-aaf3-7f8ed5656bb2" released by "delete_volume" :: held 1.251s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:25 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Created reservations ['f756e56a-8890-4a17-9895-1fe25f214aad', 'cc927843-3d5b-4bf9-b2c6-2fcee29ee03b', 'abad2efc-5892-431d-b65d-0f60727f2e8a', '7113f371-42fa-4824-8def-e43b52cca278'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:35:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.152s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:26 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:26 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Deleted volume successfully.
Sep 10 19:35:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-97a0c55d-400c-42dd-af51-960c676fb339 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "cinder-3a2aac06-976c-4587-aaf3-7f8ed5656bb2-delete_volume" released by "delete_volume" :: held 3.420s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "cinder-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "cinder-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:27 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "cinder-quobyte-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "cinder-quobyte-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7" acquired by "delete_volume" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:27 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc55e5ac-97d4-4790-9839-b1429526b501]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7" returned: 0 in 0.485s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7" returned: 0 in 0.119s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "cinder-quobyte-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7" released by "delete_volume" :: held 0.815s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:28 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Created reservations ['1245d347-1cb9-4c9c-a986-5fa47a090c5a', 'cf139f30-172a-4726-afb1-e3f55a17b202', 'adf37ae7-e9a3-46fd-8798-ed63a70eda36', 'da64e2f8-e0ab-4456-af9e-384e278799e5'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:35:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.128s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:28 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:28 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Deleted volume successfully.
Sep 10 19:35:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-38a9e45c-231a-4586-bce3-28d9e5b711f5 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "cinder-cf8726a9-3b88-42e0-aa9f-acb27bbf0fe7-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "cinder-6361bb15-18b8-4e9c-ab62-76a14aacfe19-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "cinder-6361bb15-18b8-4e9c-ab62-76a14aacfe19-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:29 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "cinder-quobyte-6361bb15-18b8-4e9c-ab62-76a14aacfe19" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "cinder-quobyte-6361bb15-18b8-4e9c-ab62-76a14aacfe19" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:29 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6066f49b-ae14-423f-ae9d-691cce5f4e63]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19" returned: 0 in 0.735s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6361bb15-18b8-4e9c-ab62-76a14aacfe19" returned: 0 in 0.475s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "cinder-quobyte-6361bb15-18b8-4e9c-ab62-76a14aacfe19" released by "delete_volume" :: held 1.456s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:32 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Created reservations ['d0fb0867-1d6c-4465-a892-1b08fe30bca1', 'd5273e80-e93d-41bc-aa5b-6e50765a2d94', '569c50af-7e7c-4702-addd-3244eadbbb74', 'c8c49956-39d3-43c3-b526-e84cc03f1f90'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:35:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.113s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:32 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:32 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Deleted volume successfully.
Sep 10 19:35:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-eb711807-01bf-40f7-b4bc-d8f83006c9e3 tempest-AttachVolumeNegativeTest-1515327604 None] Lock "cinder-6361bb15-18b8-4e9c-ab62-76a14aacfe19-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:36 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:36 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Flow 'volume_create_manager' (72d5a45d-ade8-4d37-ad93-aef99f910850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b215848b-56dd-4d21-800b-b15bae16bd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b215848b-56dd-4d21-800b-b15bae16bd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-571648568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab354fdb-177c-403a-90fd-0852e09ca88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9904257679f46e2a34e96fb027b225c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:36Z,use_quota=True,user_id='8b1b7a85019247b3a4ea599857c20e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b7fd87-1731-403d-a73c-c5e857396fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b7fd87-1731-403d-a73c-c5e857396fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c5ed13-b924-40e0-be30-32d338d4d8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c5ed13-b924-40e0-be30-32d338d4d8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ab354fdb-177c-403a-90fd-0852e09ca88d', 'volume_name': 'volume-ab354fdb-177c-403a-90fd-0852e09ca88d', 'volume_size': 1, 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '489167b5c946434eba8a26e1f48a2447', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'created_at': datetime.datetime(2025, 9, 10, 17, 8, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/391d42a7-95bd-4118-889d-f5820ea8d60f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc578f47100>}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eed0982-d2d2-474e-9141-247ca253f748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eed0982-d2d2-474e-9141-247ca253f748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d0413e-3bb0-4e76-a3e6-fa7b5e883200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:37 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Volume ab354fdb-177c-403a-90fd-0852e09ca88d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ab354fdb-177c-403a-90fd-0852e09ca88d', 'volume_size': 1, 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '489167b5c946434eba8a26e1f48a2447', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'created_at': datetime.datetime(2025, 9, 10, 17, 8, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/391d42a7-95bd-4118-889d-f5820ea8d60f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc578f47100>}
Sep 10 19:35:37 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Cloning ab354fdb-177c-403a-90fd-0852e09ca88d from image 391d42a7-95bd-4118-889d-f5820ea8d60f  at location (None, None). {{(pid=82850) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 19:35:37 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f__htc905sdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 19:35:37 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Image download 20.69 MB at 20.69 MB/s
Sep 10 19:35:38 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f08e47-6291-4653-abb6-321e5657dff7]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f__htc905sdevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:38 devstack sudo[91475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f__htc905sdevstack@QuobyteHD
Sep 10 19:35:38 devstack sudo[91475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:35:41 devstack sudo[91475]: pam_unix(sudo:session): session closed for user root
Sep 10 19:35:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f__htc905sdevstack@QuobyteHD" returned: 0 in 3.100s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:41 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Temporary image 391d42a7-95bd-4118-889d-f5820ea8d60f is fetched for user 8b1b7a85019247b3a4ea599857c20e21. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 19:35:41 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4a5d35-59f2-4b90-8945-ddb160e26db0]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f__htc905sdevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:42 devstack sudo[91480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f__htc905sdevstack@QuobyteHD
Sep 10 19:35:42 devstack sudo[91480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:35:44 devstack sudo[91480]: pam_unix(sudo:session): session closed for user root
Sep 10 19:35:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f__htc905sdevstack@QuobyteHD" returned: 0 in 2.650s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-571648568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab354fdb-177c-403a-90fd-0852e09ca88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9904257679f46e2a34e96fb027b225c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:36Z,use_quota=True,user_id='8b1b7a85019247b3a4ea599857c20e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:35:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Creating volume ab354fdb-177c-403a-90fd-0852e09ca88d {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:35:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:35:44 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:35:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:44 devstack quobyte-client[82855]: System call of process 91486 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:35:44 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=52, name=volume-ab354fdb-177c-403a-90fd-0852e09ca88d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:35:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d 1073741824" returned: 0 in 0.492s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d" returned: 0 in 0.140s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] <== create_volume: return (785ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:35:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:45 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Attempting download of 391d42a7-95bd-4118-889d-f5820ea8d60f ((None, None)) to volume ab354fdb-177c-403a-90fd-0852e09ca88d. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 19:35:45 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7a42cb-11b0-4cf5-a2bb-4fb1f374d874]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_5noo3ia3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_5noo3ia3" returned: 0 in 0.581s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_5noo3ia3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_5noo3ia3" returned: 1 in 0.510s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_5noo3ia3' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:35:46 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[08997fcb-cfac-4a11-b43f-1a04c08a854c]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f__htc905sdevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f__htc905sdevstack@QuobyteHD" returned: 0 in 0.532s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:47 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] 391d42a7-95bd-4118-889d-f5820ea8d60f was qcow2, converting to raw {{(pid=82850) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 19:35:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f__htc905sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:47 devstack quobyte-client[82855]: System call of process 91499 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:35:47 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=52, name=volume-ab354fdb-177c-403a-90fd-0852e09ca88d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:35:48 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Flow 'volume_create_manager' (2510201b-2e64-45e8-a002-63a5b3c33bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8135b596-e76f-4426-9e0d-646af2a37a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8135b596-e76f-4426-9e0d-646af2a37a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1749223730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed2c35c-1bd9-4390-9140-a40b18d74a51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9057954110a4e6a82655578ab3d604e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:48Z,use_quota=True,user_id='104e7c0c627e44029e968cd21dfbb400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a76ae24-3083-49e7-a5fe-139899668342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a76ae24-3083-49e7-a5fe-139899668342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaebdb35-fe4e-466d-b98b-0794332eec12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaebdb35-fe4e-466d-b98b-0794332eec12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed2c35c-1bd9-4390-9140-a40b18d74a51', 'volume_name': 'volume-0ed2c35c-1bd9-4390-9140-a40b18d74a51', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11d4d44-a53e-4edc-a876-dce736a1960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11d4d44-a53e-4edc-a876-dce736a1960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbe1270-2d57-4323-ba89-48172e222030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:48 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Volume 0ed2c35c-1bd9-4390-9140-a40b18d74a51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed2c35c-1bd9-4390-9140-a40b18d74a51', 'volume_size': 1}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1749223730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed2c35c-1bd9-4390-9140-a40b18d74a51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9057954110a4e6a82655578ab3d604e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:48Z,use_quota=True,user_id='104e7c0c627e44029e968cd21dfbb400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Creating volume 0ed2c35c-1bd9-4390-9140-a40b18d74a51 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:35:48 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0ed2c35c-1bd9-4390-9140-a40b18d74a51 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:48 devstack quobyte-client[82855]: System call of process 91509 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:35:48 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=53, name=volume-0ed2c35c-1bd9-4390-9140-a40b18d74a51, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0ed2c35c-1bd9-4390-9140-a40b18d74a51 1073741824" returned: 0 in 0.582s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0ed2c35c-1bd9-4390-9140-a40b18d74a51 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0ed2c35c-1bd9-4390-9140-a40b18d74a51" returned: 0 in 0.143s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] <== create_volume: return (828ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:35:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f__htc905sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d" returned: 0 in 1.707s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:49 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f__htc905sdevstack@QuobyteHD, size 112.00 MB, duration 1.71 sec, destination /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:35:49 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Converted 112.00 MB image at 65.43 MB/s
Sep 10 19:35:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbe1270-2d57-4323-ba89-48172e222030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed2c35c-1bd9-4390-9140-a40b18d74a51', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9265bc98-04be-4468-a9a0-9550d298c2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d 1G" returned: 0 in 0.305s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:49 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Volume volume-0ed2c35c-1bd9-4390-9140-a40b18d74a51 (0ed2c35c-1bd9-4390-9140-a40b18d74a51): created successfully
Sep 10 19:35:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9265bc98-04be-4468-a9a0-9550d298c2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Flow 'volume_create_manager' (2510201b-2e64-45e8-a002-63a5b3c33bc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:49 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21b4a2f-bd41-4545-a300-1e833a58bcd7]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:49 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-826918e1-e6ff-4376-9567-8d5cdc2e1ad0 req-9bde1efb-11a4-4b44-b0b4-521bca811b53 tempest-VolumesGetTestJSON-311084127 None] Created volume successfully.
Sep 10 19:35:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Acquiring lock "cinder-0ed2c35c-1bd9-4390-9140-a40b18d74a51-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:50 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-430f8c03-42cb-472f-95d4-57561606cbc9 req-f3083dbf-0360-41c9-81e5-44923a301b35 tempest-AttachVolumeShelveTestJSON-254880779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d" returned: 0 in 0.857s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Lock "cinder-0ed2c35c-1bd9-4390-9140-a40b18d74a51-delete_volume" acquired by "delete_volume" :: waited 0.359s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:50 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-430f8c03-42cb-472f-95d4-57561606cbc9 req-f3083dbf-0360-41c9-81e5-44923a301b35 tempest-AttachVolumeShelveTestJSON-254880779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-430f8c03-42cb-472f-95d4-57561606cbc9 req-f3083dbf-0360-41c9-81e5-44923a301b35 tempest-AttachVolumeShelveTestJSON-254880779 None] No connector for attachment c44b06f8-45ce-48f4-a84e-f98f82079e81; skipping storage backend terminate_connection call. {{(pid=82850) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 10 19:35:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-430f8c03-42cb-472f-95d4-57561606cbc9 req-f3083dbf-0360-41c9-81e5-44923a301b35 tempest-AttachVolumeShelveTestJSON-254880779 None] Deleting attachment c44b06f8-45ce-48f4-a84e-f98f82079e81. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:35:51 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Acquiring lock "cinder-quobyte-0ed2c35c-1bd9-4390-9140-a40b18d74a51" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Lock "cinder-quobyte-0ed2c35c-1bd9-4390-9140-a40b18d74a51" acquired by "delete_volume" :: waited 0.041s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d" returned: 1 in 0.560s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:35:51 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Downloaded image 391d42a7-95bd-4118-889d-f5820ea8d60f ((None, None)) to volume ab354fdb-177c-403a-90fd-0852e09ca88d successfully. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 19:35:51 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Temporary image 391d42a7-95bd-4118-889d-f5820ea8d60f for user 8b1b7a85019247b3a4ea599857c20e21 is deleted. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 19:35:51 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Marking volume ab354fdb-177c-403a-90fd-0852e09ca88d as bootable. {{(pid=82850) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 19:35:51 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3aa8baf-8c18-4869-8fde-33735efecfe0]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0ed2c35c-1bd9-4390-9140-a40b18d74a51 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:51 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Copying metadata from image 391d42a7-95bd-4118-889d-f5820ea8d60f to ab354fdb-177c-403a-90fd-0852e09ca88d. {{(pid=82850) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 19:35:51 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Creating volume glance metadata for volume ab354fdb-177c-403a-90fd-0852e09ca88d backed by image 391d42a7-95bd-4118-889d-f5820ea8d60f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82850) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 19:35:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d0413e-3bb0-4e76-a3e6-fa7b5e883200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab354fdb-177c-403a-90fd-0852e09ca88d', 'volume_size': 1, 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '489167b5c946434eba8a26e1f48a2447', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'created_at': datetime.datetime(2025, 9, 10, 17, 8, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/391d42a7-95bd-4118-889d-f5820ea8d60f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc578f47100>}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c677473-92a3-4a18-a09e-3f2bd46c99ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0ed2c35c-1bd9-4390-9140-a40b18d74a51" returned: 0 in 1.100s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0ed2c35c-1bd9-4390-9140-a40b18d74a51 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:52 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Volume volume-ab354fdb-177c-403a-90fd-0852e09ca88d (ab354fdb-177c-403a-90fd-0852e09ca88d): created successfully
Sep 10 19:35:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c677473-92a3-4a18-a09e-3f2bd46c99ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Flow 'volume_create_manager' (72d5a45d-ade8-4d37-ad93-aef99f910850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0ed2c35c-1bd9-4390-9140-a40b18d74a51" returned: 0 in 0.582s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:52 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1d4bb09e-c847-4de6-8023-e03d9e7c928b tempest-VolumesExtendTest-79417219 None] Created volume successfully.
Sep 10 19:35:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Lock "cinder-quobyte-0ed2c35c-1bd9-4390-9140-a40b18d74a51" released by "delete_volume" :: held 1.850s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:53 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c92e3794-3329-40d7-94ae-4fcd6b2a7a38 tempest-VolumesExtendTest-79417219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c92e3794-3329-40d7-94ae-4fcd6b2a7a38 tempest-VolumesExtendTest-79417219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c92e3794-3329-40d7-94ae-4fcd6b2a7a38 tempest-VolumesExtendTest-79417219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:53 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[938b0bd8-dcb1-4cc8-9cc0-c698519c9b7c]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c92e3794-3329-40d7-94ae-4fcd6b2a7a38 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:53 devstack cinder-volume[82850]: DEBUG cinder.quota [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Created reservations ['159273da-f5b3-4dc5-92e6-1b1f23259edf', 'b7ea03c8-203f-4b34-9b77-592fe36a2b21', '107b7e39-65e3-4102-bf64-8492e403aff4', '7f269905-eee3-45e2-a3fc-811a878aba31'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:35:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c92e3794-3329-40d7-94ae-4fcd6b2a7a38 tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d" returned: 0 in 0.580s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c92e3794-3329-40d7-94ae-4fcd6b2a7a38 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.059s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.123s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:54 devstack cinder-volume[82850]: DEBUG cinder.manager [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Deleted volume successfully.
Sep 10 19:35:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c92e3794-3329-40d7-94ae-4fcd6b2a7a38 tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d" returned: 1 in 0.919s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c92e3794-3329-40d7-94ae-4fcd6b2a7a38 tempest-VolumesExtendTest-79417219 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:35:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c92e3794-3329-40d7-94ae-4fcd6b2a7a38 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d 2G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:54 devstack quobyte-client[82855]: System call of process 91565 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:35:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-20777b7b-b440-408b-b033-374a00a26f0f req-c03ec67e-dd11-4c49-8440-9bb334d1dc13 tempest-VolumesGetTestJSON-311084127 None] Lock "cinder-0ed2c35c-1bd9-4390-9140-a40b18d74a51-delete_volume" released by "delete_volume" :: held 4.147s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c92e3794-3329-40d7-94ae-4fcd6b2a7a38 tempest-VolumesExtendTest-79417219 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d 2G" returned: 0 in 0.291s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c92e3794-3329-40d7-94ae-4fcd6b2a7a38 tempest-VolumesExtendTest-79417219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.938s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:55 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c92e3794-3329-40d7-94ae-4fcd6b2a7a38 tempest-VolumesExtendTest-79417219 None] Extend volume completed successfully.
Sep 10 19:35:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Acquiring lock "cinder-ab354fdb-177c-403a-90fd-0852e09ca88d-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Lock "cinder-ab354fdb-177c-403a-90fd-0852e09ca88d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:56 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Acquiring lock "cinder-quobyte-ab354fdb-177c-403a-90fd-0852e09ca88d" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Lock "cinder-quobyte-ab354fdb-177c-403a-90fd-0852e09ca88d" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:57 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f6aedb-5853-4bff-b05b-1c4f163c6d9f]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d" returned: 0 in 0.429s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:58 devstack quobyte-client[82855]: System call of process 91572 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:35:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d" returned: 1 in 0.556s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:35:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ab354fdb-177c-403a-90fd-0852e09ca88d" returned: 0 in 0.108s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Lock "cinder-quobyte-ab354fdb-177c-403a-90fd-0852e09ca88d" released by "delete_volume" :: held 1.363s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:58 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Created reservations ['b1e650fb-8e77-46c2-b861-791157186628', '1476738b-43c7-4b9b-86ff-3372b9b5982d', 'ba2deb16-02d3-47a3-b44b-0d31f9a7a272', '5e29a3c8-a7a6-42e4-9957-624fcbb43e84'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:35:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.099s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:58 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Deleted volume successfully.
Sep 10 19:35:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-da27305e-b03f-4365-911a-b8ce33be36b1 tempest-VolumesExtendTest-79417219 None] Lock "cinder-ab354fdb-177c-403a-90fd-0852e09ca88d-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:59 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:59 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Flow 'volume_create_manager' (5fe76f14-ceda-4e29-8519-f6b9e45ba8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0784a9e1-41e0-4161-b150-ac31385cf5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0784a9e1-41e0-4161-b150-ac31385cf5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2048247505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d17b904-20ca-4f34-97a9-7bfef40ac25d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9904257679f46e2a34e96fb027b225c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:00Z,use_quota=True,user_id='8b1b7a85019247b3a4ea599857c20e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a3f92d-0d1f-469e-a236-6b6817c90e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a3f92d-0d1f-469e-a236-6b6817c90e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a39a38-85b6-4b98-814b-75a0c1f8d4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a39a38-85b6-4b98-814b-75a0c1f8d4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d17b904-20ca-4f34-97a9-7bfef40ac25d', 'volume_name': 'volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe64c32-0bd9-4505-8499-38cac2d85153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe64c32-0bd9-4505-8499-38cac2d85153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017dee27-7231-4c73-ab0f-90e48db1b5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:00 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Volume 3d17b904-20ca-4f34-97a9-7bfef40ac25d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d', 'volume_size': 1}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2048247505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d17b904-20ca-4f34-97a9-7bfef40ac25d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9904257679f46e2a34e96fb027b225c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:00Z,use_quota=True,user_id='8b1b7a85019247b3a4ea599857c20e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Creating volume 3d17b904-20ca-4f34-97a9-7bfef40ac25d {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:00 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:00 devstack quobyte-client[82855]: System call of process 91577 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e1520caf-85e0-43d5-b122-6dabb689f3a5 tempest-BackendsCapabilitiesAdminTestsJSON-1125444209 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.8652381896973, 'free_capacity_gb': 924.8652381896973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82850) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 10 19:36:00 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=54, name=volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d 1073741824" returned: 0 in 0.491s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ce186777-2414-4c78-adf4-09bd64d31658 tempest-BackendsCapabilitiesAdminTestsJSON-1125444209 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.8652381896973, 'free_capacity_gb': 924.8652381896973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82850) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d" returned: 0 in 0.329s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] <== create_volume: return (848ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017dee27-7231-4c73-ab0f-90e48db1b5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e1e7bb-1744-4a7b-9828-c0e9f5e7df47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:01 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Volume volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d (3d17b904-20ca-4f34-97a9-7bfef40ac25d): created successfully
Sep 10 19:36:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e1e7bb-1744-4a7b-9828-c0e9f5e7df47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Flow 'volume_create_manager' (5fe76f14-ceda-4e29-8519-f6b9e45ba8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a7bfe14c-a85d-4b3b-8cc5-31b4b7a9c092 tempest-VolumesExtendTest-79417219 None] Created volume successfully.
Sep 10 19:36:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] Creating offline snapshot 7c8d4b25-c869-402a-8b8a-021cbec44ff7 of volume 3d17b904-20ca-4f34-97a9-7bfef40ac25d {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:36:02 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ad443c-7e1c-4b6f-b8cc-56ee5d996b76]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d" returned: 0 in 0.534s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:03 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=55, name=volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:36:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7 1G" returned: 0 in 0.338s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:03 devstack quobyte-client[82855]: System call of process 91588 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] CMD "qemu-img rebase -u -b volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7" returned: 0 in 0.248s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:36:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7" returned: 0 in 0.133s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:36:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7" returned: 0 in 0.299s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.info" returned: 0 in 0.161s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:36:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.info" returned: 0 in 0.125s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:05 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=46,cinder:UPDATE=71,cinder:DELETE=6,cinder:INSERT=21 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:36:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9039e0ff-c477-4570-98fb-500792167be8 tempest-VolumesExtendTest-79417219 None] Create snapshot completed successfully
Sep 10 19:36:05 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-ff7f43e2-51ad-4e4c-b357-a9dc77fb8c31 tempest-VolumesExtendTest-79417219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff7f43e2-51ad-4e4c-b357-a9dc77fb8c31 tempest-VolumesExtendTest-79417219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff7f43e2-51ad-4e4c-b357-a9dc77fb8c31 tempest-VolumesExtendTest-79417219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82406f2-f27d-4094-8272-45ab01ff5db7]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff7f43e2-51ad-4e4c-b357-a9dc77fb8c31 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff7f43e2-51ad-4e4c-b357-a9dc77fb8c31 tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d" returned: 0 in 0.741s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff7f43e2-51ad-4e4c-b357-a9dc77fb8c31 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7 2G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff7f43e2-51ad-4e4c-b357-a9dc77fb8c31 tempest-VolumesExtendTest-79417219 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7 2G" returned: 0 in 0.379s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff7f43e2-51ad-4e4c-b357-a9dc77fb8c31 tempest-VolumesExtendTest-79417219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.366s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ff7f43e2-51ad-4e4c-b357-a9dc77fb8c31 tempest-VolumesExtendTest-79417219 None] Extend volume completed successfully.
Sep 10 19:36:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Acquiring lock "cinder-7c8d4b25-c869-402a-8b8a-021cbec44ff7-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Lock "cinder-7c8d4b25-c869-402a-8b8a-021cbec44ff7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.128s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:09 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Acquiring lock "cinder-quobyte-3d17b904-20ca-4f34-97a9-7bfef40ac25d" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Lock "cinder-quobyte-3d17b904-20ca-4f34-97a9-7bfef40ac25d" acquired by "delete_snapshot" :: waited 0.039s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Acquiring lock "cinder-quobyte-7c8d4b25-c869-402a-8b8a-021cbec44ff7" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Lock "cinder-quobyte-7c8d4b25-c869-402a-8b8a-021cbec44ff7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Deleting offline snapshot 7c8d4b25-c869-402a-8b8a-021cbec44ff7 of volume 3d17b904-20ca-4f34-97a9-7bfef40ac25d {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:36:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] snapshot_file for this snap is: volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:36:09 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fb975c-690b-47c1-a497-86b712c064bc]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7" returned: 0 in 0.597s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:09 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04eea4a-30a4-46fc-9420-09e6cbce2505]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d" returned: 0 in 0.701s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7" returned: 0 in 0.363s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d.7c8d4b25-c869-402a-8b8a-021cbec44ff7" returned: 0 in 0.163s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Lock "cinder-quobyte-7c8d4b25-c869-402a-8b8a-021cbec44ff7" released by "_delete_snapshot" :: held 2.320s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Lock "cinder-quobyte-3d17b904-20ca-4f34-97a9-7bfef40ac25d" released by "delete_snapshot" :: held 2.373s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:11 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=79,cinder:SELECT=63,cinder:INSERT=20,cinder:DELETE=8 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:36:11 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:11 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:36:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Flow 'volume_create_manager' (4bf9467b-3e9a-4a8e-972d-edec9d787517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986a8f29-aadd-4cf9-9e98-3cbc04808ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986a8f29-aadd-4cf9-9e98-3cbc04808ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1499760951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a745f12f-3de6-4f7f-863d-af3ec99f8402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1231746043624e89ad27fbb2db21e82c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:12Z,use_quota=True,user_id='a9769fac16b64fdeb963ac8c265b12e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafd23c7-0114-4ca3-8624-27cbf4ea7a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafd23c7-0114-4ca3-8624-27cbf4ea7a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27d9787-975e-42fd-9a87-7a30cd4f3b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27d9787-975e-42fd-9a87-7a30cd4f3b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a745f12f-3de6-4f7f-863d-af3ec99f8402', 'volume_name': 'volume-a745f12f-3de6-4f7f-863d-af3ec99f8402', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6eb405f-363d-4efe-be7d-b6185c5aa40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6eb405f-363d-4efe-be7d-b6185c5aa40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96762f3-7a89-4225-b273-e71597c3ebe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:12 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Volume a745f12f-3de6-4f7f-863d-af3ec99f8402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a745f12f-3de6-4f7f-863d-af3ec99f8402', 'volume_size': 1}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1499760951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a745f12f-3de6-4f7f-863d-af3ec99f8402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1231746043624e89ad27fbb2db21e82c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:12Z,use_quota=True,user_id='a9769fac16b64fdeb963ac8c265b12e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Creating volume a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:12 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:12 devstack quobyte-client[82855]: System call of process 91649 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:12 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=57, name=volume-a745f12f-3de6-4f7f-863d-af3ec99f8402, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Created reservations ['7c41355b-25c0-4cbc-a606-6385c08825c0', '65130da8-d265-42bd-bd4f-09665216aa38', '9862e286-b338-40c0-90c5-38879c92f89e', 'a47db203-313c-4c17-ae92-0497566169d1'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402 1073741824" returned: 0 in 0.614s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:13 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Delete snapshot completed successfully.
Sep 10 19:36:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402" returned: 0 in 0.497s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] <== create_volume: return (1134ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4bdbf39b-3f79-4a6e-a07c-e31b7c526b07 tempest-VolumesExtendTest-79417219 None] Lock "cinder-7c8d4b25-c869-402a-8b8a-021cbec44ff7-delete_snapshot" released by "delete_snapshot" :: held 4.270s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96762f3-7a89-4225-b273-e71597c3ebe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a745f12f-3de6-4f7f-863d-af3ec99f8402', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb4b883-0fa0-4ca9-9ebc-6cf6539021f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:13 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Volume volume-a745f12f-3de6-4f7f-863d-af3ec99f8402 (a745f12f-3de6-4f7f-863d-af3ec99f8402): created successfully
Sep 10 19:36:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb4b883-0fa0-4ca9-9ebc-6cf6539021f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Flow 'volume_create_manager' (4bf9467b-3e9a-4a8e-972d-edec9d787517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:13 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d0a3f3af-7c2f-4d95-b944-0a3833179e0d tempest-SnapshotsActionsTest-321923239 None] Created volume successfully.
Sep 10 19:36:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Acquiring lock "cinder-3d17b904-20ca-4f34-97a9-7bfef40ac25d-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Lock "cinder-3d17b904-20ca-4f34-97a9-7bfef40ac25d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:13 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Acquiring lock "cinder-quobyte-3d17b904-20ca-4f34-97a9-7bfef40ac25d" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Lock "cinder-quobyte-3d17b904-20ca-4f34-97a9-7bfef40ac25d" acquired by "delete_volume" :: waited 0.024s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:36:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:14 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf83c5e-77da-437d-83aa-4ef16950e8e2]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.843s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:15 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] Creating offline snapshot 006b8034-608b-4ce9-a00f-6dbb8d1c7b23 of volume a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:36:15 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6839ae49-3e08-45d4-aa3c-e6354664f59e]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:15 devstack quobyte-client[82855]: System call of process 91654 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d" returned: 0 in 1.150s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3d17b904-20ca-4f34-97a9-7bfef40ac25d" returned: 0 in 0.141s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Lock "cinder-quobyte-3d17b904-20ca-4f34-97a9-7bfef40ac25d" released by "delete_volume" :: held 1.749s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:15 devstack quobyte-client[82855]: System call of process 91655 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402" returned: 0 in 0.848s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:16 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=58, name=volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:36:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 1G" returned: 0 in 0.454s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a745f12f-3de6-4f7f-863d-af3ec99f8402 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] CMD "qemu-img rebase -u -b volume-a745f12f-3de6-4f7f-863d-af3ec99f8402 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23" returned: 0 in 0.273s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:36:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23" returned: 0 in 0.195s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:36:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:17 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Created reservations ['10635d67-e8d7-4ec0-b52a-b3e2237277c5', 'c547b858-0f7a-45d1-95e9-ca07d3a1e027', 'ee0cdb7a-8355-4909-bc9d-6b4fe35275df', 'b7ff0ddc-5cf1-4e33-95c4-7c176bf487e9'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23" returned: 0 in 0.342s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.info" returned: 0 in 0.331s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:36:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.info" returned: 0 in 0.224s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.981s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.463s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:18 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:18 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Deleted volume successfully.
Sep 10 19:36:18 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7bb18f18-9c3b-4e2d-972f-4647179dfc8c tempest-SnapshotsActionsTest-321923239 None] Create snapshot completed successfully
Sep 10 19:36:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-13c0a8b0-5631-4a09-9f1d-4f117b348b1a tempest-VolumesExtendTest-79417219 None] Lock "cinder-3d17b904-20ca-4f34-97a9-7bfef40ac25d-delete_volume" released by "delete_volume" :: held 5.443s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:20 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] Creating offline snapshot cbaf4018-8128-4ef3-9458-8e8472749856 of volume a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:36:20 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9c525e-6073-47e5-904f-bea63b65ca10]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23" returned: 0 in 0.764s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a745f12f-3de6-4f7f-863d-af3ec99f8402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:21 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=60, name=volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:36:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856 1G" returned: 0 in 0.419s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] CMD "qemu-img rebase -u -b volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856" returned: 0 in 0.172s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:36:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856" returned: 0 in 0.100s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:36:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856" returned: 0 in 0.120s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-21c7682b-e766-409e-a4e0-1b6c689a09ee tempest-SnapshotsActionsTest-321923239 None] Create snapshot completed successfully
Sep 10 19:36:23 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:23 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:36:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Flow 'volume_create_manager' (f4653129-2ea8-42f3-95f2-cd2bc5291f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5466dad-d6da-437a-b21c-8ddbc43768c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Acquiring lock "cinder-cbaf4018-8128-4ef3-9458-8e8472749856-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5466dad-d6da-437a-b21c-8ddbc43768c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-745960774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49501ee5-fc35-40d5-806e-fe12fc8dfda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c4fe7a8d104f658d4b9c50d28368f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:24Z,use_quota=True,user_id='5afd44adf1df454c8bb26d276d4fe8ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4085591f-3efd-4f09-b578-369f325da099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4085591f-3efd-4f09-b578-369f325da099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78aeb94e-a5d8-4455-af95-cbef83712c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78aeb94e-a5d8-4455-af95-cbef83712c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49501ee5-fc35-40d5-806e-fe12fc8dfda5', 'volume_name': 'volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10bb4fd2-df08-4e51-8884-252f9eb93ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10bb4fd2-df08-4e51-8884-252f9eb93ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8765dc99-ee11-4d98-9163-3da002413b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:24 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Volume 49501ee5-fc35-40d5-806e-fe12fc8dfda5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5', 'volume_size': 1}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-745960774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49501ee5-fc35-40d5-806e-fe12fc8dfda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c4fe7a8d104f658d4b9c50d28368f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:24Z,use_quota=True,user_id='5afd44adf1df454c8bb26d276d4fe8ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Creating volume 49501ee5-fc35-40d5-806e-fe12fc8dfda5 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:24 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-cbaf4018-8128-4ef3-9458-8e8472749856-delete_snapshot" acquired by "delete_snapshot" :: waited 0.308s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:24 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:24 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=61, name=volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Acquiring lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" acquired by "delete_snapshot" :: waited 0.185s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Acquiring lock "cinder-quobyte-cbaf4018-8128-4ef3-9458-8e8472749856" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-cbaf4018-8128-4ef3-9458-8e8472749856" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Deleting offline snapshot cbaf4018-8128-4ef3-9458-8e8472749856 of volume a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] snapshot_file for this snap is: volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5 1073741824" returned: 0 in 0.594s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d840dc03-3c11-4153-be0f-b5abd313aba2]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5" returned: 0 in 0.299s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] <== create_volume: return (959ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8765dc99-ee11-4d98-9163-3da002413b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69754f4-62ae-4fb2-a519-002e16e88acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:25 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Volume volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5 (49501ee5-fc35-40d5-806e-fe12fc8dfda5): created successfully
Sep 10 19:36:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69754f4-62ae-4fb2-a519-002e16e88acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Flow 'volume_create_manager' (f4653129-2ea8-42f3-95f2-cd2bc5291f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856" returned: 0 in 0.713s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a745f12f-3de6-4f7f-863d-af3ec99f8402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:25 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7552229a-9d51-4ec1-aeae-5e42c83917f1 tempest-VolumesSnapshotListTestJSON-295829904 None] Created volume successfully.
Sep 10 19:36:25 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76d9455-cc6b-4bd1-81b4-cba48f43a0cc]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23" returned: 0 in 0.792s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a745f12f-3de6-4f7f-863d-af3ec99f8402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:26 devstack quobyte-client[82855]: System call of process 91716 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856" returned: 0 in 0.412s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:27 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.cbaf4018-8128-4ef3-9458-8e8472749856" returned: 0 in 0.829s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] Creating offline snapshot d23dbcad-7121-43d8-bf71-3f39710f44c6 of volume 49501ee5-fc35-40d5-806e-fe12fc8dfda5 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:36:27 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee677809-10bb-4b2f-b447-2c9b8901b3fd]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-cbaf4018-8128-4ef3-9458-8e8472749856" released by "_delete_snapshot" :: held 3.669s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" released by "delete_snapshot" :: held 4.034s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:28 devstack quobyte-client[82855]: System call of process 91739 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:28 devstack quobyte-client[82855]: System call of process 91739 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5" returned: 0 in 1.481s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:29 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=62, name=volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:36:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 1G" returned: 0 in 1.010s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): qemu-img rebase -u -b volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:30 devstack quobyte-client[82855]: System call of process 91777 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:31 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Created reservations ['4923108f-7cd2-47de-bb69-cbab53252c6a', '28a35f80-38e4-4d81-8a67-c94796c903bb', '6cd32f97-466d-4777-9dfc-59b4034ea9f7', 'e53d666a-5215-4899-b5b8-f827e215b847'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "qemu-img rebase -u -b volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6" returned: 0 in 1.285s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:36:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6" returned: 0 in 0.664s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:36:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6" returned: 0 in 0.638s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.info" returned: 0 in 0.395s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:36:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.info" returned: 0 in 0.319s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Delete snapshot completed successfully.
Sep 10 19:36:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3cfc35f7-eeb6-4541-8400-cf3a33311e12 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-cbaf4018-8128-4ef3-9458-8e8472749856-delete_snapshot" released by "delete_snapshot" :: held 10.331s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-41a8651e-643f-44c0-97c8-0207d8dc0850 tempest-VolumesSnapshotListTestJSON-295829904 None] Create snapshot completed successfully
Sep 10 19:36:34 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] Creating offline snapshot e27773c5-f336-4d12-8cc9-84e8a5e1b871 of volume a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:36:34 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[488abb97-601c-4c41-8e05-0c47f15a3de7]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23" returned: 0 in 0.621s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a745f12f-3de6-4f7f-863d-af3ec99f8402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:35 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=64, name=volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:36:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871 1G" returned: 0 in 0.484s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] CMD "qemu-img rebase -u -b volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871" returned: 0 in 0.742s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:36:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871" returned: 0 in 0.519s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:36:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:38 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871" returned: 0 in 0.432s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.200s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.246s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] Creating offline snapshot ec73fcc6-5346-4052-ac16-d61c1736ae3a of volume 49501ee5-fc35-40d5-806e-fe12fc8dfda5 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:36:38 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7d8a1f-61d1-40df-b74c-70ad44444d69]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:38 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-210ff8ad-0580-4fbf-8fc1-51de32db2e62 tempest-SnapshotsActionsTest-321923239 None] Create snapshot completed successfully
Sep 10 19:36:39 devstack quobyte-client[82855]: System call of process 91819 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6" returned: 0 in 0.812s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:39 devstack quobyte-client[82855]: System call of process 91822 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:39 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=65, name=volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:36:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Acquiring lock "cinder-e27773c5-f336-4d12-8cc9-84e8a5e1b871-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a 1G" returned: 0 in 0.505s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): qemu-img rebase -u -b volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-e27773c5-f336-4d12-8cc9-84e8a5e1b871-delete_snapshot" acquired by "delete_snapshot" :: waited 0.230s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:40 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Acquiring lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "qemu-img rebase -u -b volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a" returned: 0 in 0.248s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" acquired by "delete_snapshot" :: waited 0.269s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Acquiring lock "cinder-quobyte-e27773c5-f336-4d12-8cc9-84e8a5e1b871" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a" returned: 0 in 0.271s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a" returned: 0 in 0.202s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-e27773c5-f336-4d12-8cc9-84e8a5e1b871" acquired by "_delete_snapshot" :: waited 0.425s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Deleting offline snapshot e27773c5-f336-4d12-8cc9-84e8a5e1b871 of volume a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] snapshot_file for this snap is: volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[93653519-2139-4d58-ac2e-cd93a9c27731]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:41 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d2ba64fe-6ec8-49f4-9d0e-cf5844c07ae4 tempest-VolumesSnapshotListTestJSON-295829904 None] Create snapshot completed successfully
Sep 10 19:36:41 devstack quobyte-client[82855]: System call of process 91832 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871" returned: 0 in 0.611s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a745f12f-3de6-4f7f-863d-af3ec99f8402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:41 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c53ff70-7842-4d07-8618-8bac0d33a4f3]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:42 devstack quobyte-client[82855]: System call of process 91835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23" returned: 0 in 0.711s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a745f12f-3de6-4f7f-863d-af3ec99f8402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:42 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:42 devstack quobyte-client[82855]: System call of process 91838 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] Creating offline snapshot b68c9963-c4ee-411a-9c1a-25154f6aa2b4 of volume 49501ee5-fc35-40d5-806e-fe12fc8dfda5 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:36:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871" returned: 0 in 0.365s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:42 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb592a3a-6135-4158-838b-be9b774d8da8]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.e27773c5-f336-4d12-8cc9-84e8a5e1b871" returned: 0 in 0.209s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-e27773c5-f336-4d12-8cc9-84e8a5e1b871" released by "_delete_snapshot" :: held 2.312s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" released by "delete_snapshot" :: held 2.782s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a" returned: 0 in 0.651s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:43 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Created reservations ['c723fde3-1d67-4de5-9121-441a7298706b', 'a142c519-a3fd-4d4b-bb98-0edac35e8e6c', 'c32f7038-b015-407c-8417-1f1f6b9c9fc0', 'f7516a10-96e3-456a-93b5-7f304710e919'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:43 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=66, name=volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:36:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4 1G" returned: 0 in 0.500s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): qemu-img rebase -u -b volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "qemu-img rebase -u -b volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4" returned: 0 in 0.378s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:36:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4" returned: 0 in 0.157s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:36:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4" returned: 0 in 0.142s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:45 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Delete snapshot completed successfully.
Sep 10 19:36:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-53d2445f-597a-4ebf-82d7-34bb4646f7e2 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-e27773c5-f336-4d12-8cc9-84e8a5e1b871-delete_snapshot" released by "delete_snapshot" :: held 5.235s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:45 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b1b6e381-5c9a-43af-adf3-a66db1199ae3 tempest-VolumesSnapshotListTestJSON-295829904 None] Create snapshot completed successfully
Sep 10 19:36:45 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] Creating offline snapshot 56202ac8-97af-4268-836e-f3c323aec196 of volume a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:36:45 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6e7086-1990-4741-ac85-5c92175a9f93]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23" returned: 0 in 0.463s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a745f12f-3de6-4f7f-863d-af3ec99f8402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:46 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=67, name=volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:36:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196 1G" returned: 0 in 0.331s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] CMD "qemu-img rebase -u -b volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196" returned: 0 in 0.285s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:36:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196" returned: 0 in 0.199s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:36:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196" returned: 0 in 0.292s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.076s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:47 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fcd7e016-6736-4bcc-8555-ff9f675d1f56 tempest-SnapshotsActionsTest-321923239 None] Create snapshot completed successfully
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "cinder-b68c9963-c4ee-411a-9c1a-25154f6aa2b4-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-b68c9963-c4ee-411a-9c1a-25154f6aa2b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:48 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "cinder-quobyte-49501ee5-fc35-40d5-806e-fe12fc8dfda5" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-quobyte-49501ee5-fc35-40d5-806e-fe12fc8dfda5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "cinder-quobyte-b68c9963-c4ee-411a-9c1a-25154f6aa2b4" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-quobyte-b68c9963-c4ee-411a-9c1a-25154f6aa2b4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Deleting offline snapshot b68c9963-c4ee-411a-9c1a-25154f6aa2b4 of volume 49501ee5-fc35-40d5-806e-fe12fc8dfda5 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] snapshot_file for this snap is: volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[906757ad-0882-48b5-bd4a-0084592ace3d]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Acquiring lock "cinder-56202ac8-97af-4268-836e-f3c323aec196-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-56202ac8-97af-4268-836e-f3c323aec196-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:48 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Acquiring lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Acquiring lock "cinder-quobyte-56202ac8-97af-4268-836e-f3c323aec196" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-56202ac8-97af-4268-836e-f3c323aec196" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Deleting offline snapshot 56202ac8-97af-4268-836e-f3c323aec196 of volume a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] snapshot_file for this snap is: volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbeab57-d630-4bd1-8b56-06572f35bdc8]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4" returned: 0 in 0.674s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:49 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f20383-0b4b-49b5-8e19-5a4a343d80e7]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196" returned: 0 in 0.620s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a745f12f-3de6-4f7f-863d-af3ec99f8402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:49 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff8309d-fbd1-4abb-aa5a-6565cec4f667]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23" returned: 0 in 0.499s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a745f12f-3de6-4f7f-863d-af3ec99f8402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:50 devstack quobyte-client[82855]: System call of process 91869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:50 devstack quobyte-client[82855]: System call of process 91875 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a" returned: 0 in 1.369s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196" returned: 0 in 0.497s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.56202ac8-97af-4268-836e-f3c323aec196" returned: 0 in 0.130s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-56202ac8-97af-4268-836e-f3c323aec196" released by "_delete_snapshot" :: held 2.122s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" released by "delete_snapshot" :: held 2.154s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4" returned: 0 in 0.706s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.b68c9963-c4ee-411a-9c1a-25154f6aa2b4" returned: 0 in 0.310s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-quobyte-b68c9963-c4ee-411a-9c1a-25154f6aa2b4" released by "_delete_snapshot" :: held 3.348s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-quobyte-49501ee5-fc35-40d5-806e-fe12fc8dfda5" released by "delete_snapshot" :: held 3.407s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:51 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Created reservations ['f7ab5a18-f1dd-4b40-b39b-365c9a7936d6', '7c181e54-1246-4c54-a6b8-205861616ea9', 'd62ad40a-b4d3-449f-8f1b-4217a38f90c2', '4d82c107-3da7-4bf2-9498-4d8944cee5e4'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:51 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Created reservations ['85b4c5f7-6372-4938-9ca0-28e3f4da618b', '3e61273c-5246-4ac2-b220-430d4c365917', '829c6ee5-ba33-4748-87fd-7f855c8e4941', '2df3cf17-1853-493a-9c6f-8743e342e448'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:51 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Delete snapshot completed successfully.
Sep 10 19:36:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2e673b05-b80c-4d67-85e7-f9b63cbb3804 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-56202ac8-97af-4268-836e-f3c323aec196-delete_snapshot" released by "delete_snapshot" :: held 3.100s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:51 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Delete snapshot completed successfully.
Sep 10 19:36:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8fe1d9bc-ad04-4425-a006-907d35521038 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-b68c9963-c4ee-411a-9c1a-25154f6aa2b4-delete_snapshot" released by "delete_snapshot" :: held 3.772s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "cinder-ec73fcc6-5346-4052-ac16-d61c1736ae3a-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-ec73fcc6-5346-4052-ac16-d61c1736ae3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:52 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "cinder-quobyte-49501ee5-fc35-40d5-806e-fe12fc8dfda5" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-quobyte-49501ee5-fc35-40d5-806e-fe12fc8dfda5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "cinder-quobyte-ec73fcc6-5346-4052-ac16-d61c1736ae3a" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-quobyte-ec73fcc6-5346-4052-ac16-d61c1736ae3a" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Deleting offline snapshot ec73fcc6-5346-4052-ac16-d61c1736ae3a of volume 49501ee5-fc35-40d5-806e-fe12fc8dfda5 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:36:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] snapshot_file for this snap is: volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:36:52 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbecdf54-3b88-43a0-a065-df3325e48026]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:54 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:54 devstack quobyte-client[82855]: System call of process 91894 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] Creating offline snapshot b7f33885-8362-4553-a20b-dcb26ec06f54 of volume a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:36:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a" returned: 0 in 1.351s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:54 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99ae875-eb1a-43ae-9eee-0f13b8dc418d]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:54 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea2eb0e-3d2e-457f-abbc-ff4096e91b41]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:55 devstack quobyte-client[82855]: System call of process 91920 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:55 devstack quobyte-client[82855]: System call of process 91920 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23" returned: 0 in 0.821s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a745f12f-3de6-4f7f-863d-af3ec99f8402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:55 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=68, name=volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:36:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6" returned: 0 in 0.845s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54 1G" returned: 0 in 0.438s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a" returned: 0 in 0.391s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] CMD "qemu-img rebase -u -b volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54" returned: 0 in 0.379s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:36:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.ec73fcc6-5346-4052-ac16-d61c1736ae3a" returned: 0 in 0.217s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-quobyte-ec73fcc6-5346-4052-ac16-d61c1736ae3a" released by "_delete_snapshot" :: held 3.496s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54" returned: 0 in 0.236s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-quobyte-49501ee5-fc35-40d5-806e-fe12fc8dfda5" released by "delete_snapshot" :: held 3.555s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:36:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54" returned: 0 in 0.305s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.691s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:56 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f615eca3-6b76-476e-bbe2-38e44b9b43f9 tempest-SnapshotsActionsTest-321923239 None] Create snapshot completed successfully
Sep 10 19:36:56 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Created reservations ['7af648b0-359f-4828-a36f-0a85a72f9c6f', '7c00b122-c55e-45d2-ba90-cf1b4aef73a3', '3cb02b06-294c-487c-ba5c-4916f88b5254', '562b3a3e-99ea-4eaa-8459-2835340c6c5d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:57 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Delete snapshot completed successfully.
Sep 10 19:36:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d642eb0a-b67a-4042-a3a2-d37e34f6b7d1 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-ec73fcc6-5346-4052-ac16-d61c1736ae3a-delete_snapshot" released by "delete_snapshot" :: held 4.570s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "cinder-d23dbcad-7121-43d8-bf71-3f39710f44c6-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-d23dbcad-7121-43d8-bf71-3f39710f44c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:58 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "cinder-quobyte-49501ee5-fc35-40d5-806e-fe12fc8dfda5" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-quobyte-49501ee5-fc35-40d5-806e-fe12fc8dfda5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "cinder-quobyte-d23dbcad-7121-43d8-bf71-3f39710f44c6" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-quobyte-d23dbcad-7121-43d8-bf71-3f39710f44c6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Deleting offline snapshot d23dbcad-7121-43d8-bf71-3f39710f44c6 of volume 49501ee5-fc35-40d5-806e-fe12fc8dfda5 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] snapshot_file for this snap is: volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Acquiring lock "cinder-b7f33885-8362-4553-a20b-dcb26ec06f54-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f45d3b0-8097-42b3-a3d4-8f8806eb31be]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-b7f33885-8362-4553-a20b-dcb26ec06f54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.268s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:58 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Acquiring lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Acquiring lock "cinder-quobyte-b7f33885-8362-4553-a20b-dcb26ec06f54" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-b7f33885-8362-4553-a20b-dcb26ec06f54" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Deleting offline snapshot b7f33885-8362-4553-a20b-dcb26ec06f54 of volume a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] snapshot_file for this snap is: volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c27fa3-ffc5-4c9b-94fc-4100bf479d90]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6" returned: 0 in 0.735s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0aa2a9-d3b8-43a0-80a8-2470ed09c7b4]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54" returned: 0 in 0.630s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a745f12f-3de6-4f7f-863d-af3ec99f8402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc91d96f-44ae-4454-af9b-e5bc95839210]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5" returned: 0 in 0.596s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23" returned: 0 in 0.702s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a745f12f-3de6-4f7f-863d-af3ec99f8402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:37:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:00 devstack quobyte-client[82855]: System call of process 91959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:37:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6" returned: 0 in 0.686s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54" returned: 0 in 0.549s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5.d23dbcad-7121-43d8-bf71-3f39710f44c6" returned: 0 in 0.230s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-quobyte-d23dbcad-7121-43d8-bf71-3f39710f44c6" released by "_delete_snapshot" :: held 2.665s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.b7f33885-8362-4553-a20b-dcb26ec06f54" returned: 0 in 0.215s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-quobyte-49501ee5-fc35-40d5-806e-fe12fc8dfda5" released by "delete_snapshot" :: held 2.760s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-b7f33885-8362-4553-a20b-dcb26ec06f54" released by "_delete_snapshot" :: held 2.453s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" released by "delete_snapshot" :: held 2.562s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:01 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Created reservations ['f5708292-a5d9-4900-95ad-6861c169e05a', '76ae8507-8c3f-4334-951e-d2617f156fd1', 'e4ccb23a-369c-4b87-816c-c927d90e72f2', '4b01f93f-6a48-4b30-827c-df5d8ce6e753'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:01 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Created reservations ['042ab56a-b501-4657-8d08-66f43211eee5', '8a2f5a11-8f27-4b91-bcde-b88bfade22d0', '96d7a7f4-d25d-4a49-8bb6-383f62b7d99a', 'd075d070-524b-40d4-baf8-07dc0d41e4c9'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Delete snapshot completed successfully.
Sep 10 19:37:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f28022b-684e-4160-9331-007869dd722f tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-d23dbcad-7121-43d8-bf71-3f39710f44c6-delete_snapshot" released by "delete_snapshot" :: held 3.351s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Delete snapshot completed successfully.
Sep 10 19:37:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c15127e6-37a4-402a-9032-553e9c566332 tempest-SnapshotsActionsTest-354013391 None] Lock "cinder-b7f33885-8362-4553-a20b-dcb26ec06f54-delete_snapshot" released by "delete_snapshot" :: held 3.068s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Acquiring lock "cinder-006b8034-608b-4ce9-a00f-6dbb8d1c7b23-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Lock "cinder-006b8034-608b-4ce9-a00f-6dbb8d1c7b23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Acquiring lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Acquiring lock "cinder-quobyte-006b8034-608b-4ce9-a00f-6dbb8d1c7b23" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Lock "cinder-quobyte-006b8034-608b-4ce9-a00f-6dbb8d1c7b23" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Deleting offline snapshot 006b8034-608b-4ce9-a00f-6dbb8d1c7b23 of volume a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:37:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] snapshot_file for this snap is: volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:37:02 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c07c735-fb9c-44ff-9cc6-a083a4488fc0]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "cinder-49501ee5-fc35-40d5-806e-fe12fc8dfda5-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-49501ee5-fc35-40d5-806e-fe12fc8dfda5-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:03 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "cinder-quobyte-49501ee5-fc35-40d5-806e-fe12fc8dfda5" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-quobyte-49501ee5-fc35-40d5-806e-fe12fc8dfda5" acquired by "delete_volume" :: waited 0.021s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:03 devstack quobyte-client[82855]: System call of process 91964 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:37:03 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[325890dd-aa08-42a0-9c0c-84554f602086]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23" returned: 0 in 0.782s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a745f12f-3de6-4f7f-863d-af3ec99f8402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:37:03 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e894981-523b-4d4f-bac9-c62e82b86f02]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5" returned: 0 in 0.537s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-49501ee5-fc35-40d5-806e-fe12fc8dfda5" returned: 0 in 0.174s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402" returned: 0 in 0.679s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-quobyte-49501ee5-fc35-40d5-806e-fe12fc8dfda5" released by "delete_volume" :: held 0.964s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23" returned: 0 in 0.346s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402.006b8034-608b-4ce9-a00f-6dbb8d1c7b23" returned: 0 in 0.233s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Lock "cinder-quobyte-006b8034-608b-4ce9-a00f-6dbb8d1c7b23" released by "_delete_snapshot" :: held 2.460s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" released by "delete_snapshot" :: held 2.514s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:05 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=64,cinder:INSERT=22,cinder:UPDATE=84,cinder:DELETE=5 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:37:05 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Created reservations ['fe186b04-f1a7-42b0-b91e-8b539b3a3a71', '3d67ee01-7558-41d9-aafa-050dd9692cf2', '5ddb5e57-46a7-411b-9505-2b9aed2d8599', '35310ca0-c0f9-4299-ac1d-5b68b3ece1b4'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:05 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Created reservations ['b3e5d48b-12b2-46e7-8d36-05be4affe568', '4a8eb34d-7af3-496d-82dc-19e221822c1a', '52ce24fc-fc88-477b-b4d1-7ac5a326c54b', 'defd9389-26f8-4e50-9021-c556f61ae7de'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Delete snapshot completed successfully.
Sep 10 19:37:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.432s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:06 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:37:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a6d55e06-761e-479b-9c5e-2d184d6454c3 tempest-SnapshotsActionsTest-321923239 None] Lock "cinder-006b8034-608b-4ce9-a00f-6dbb8d1c7b23-delete_snapshot" released by "delete_snapshot" :: held 3.383s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:06 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Deleted volume successfully.
Sep 10 19:37:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Acquiring lock "cinder-a745f12f-3de6-4f7f-863d-af3ec99f8402-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ef9c68e3-6440-4bf6-9664-81f4580ef016 tempest-VolumesSnapshotListTestJSON-295829904 None] Lock "cinder-49501ee5-fc35-40d5-806e-fe12fc8dfda5-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Lock "cinder-a745f12f-3de6-4f7f-863d-af3ec99f8402-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:06 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Acquiring lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" acquired by "delete_volume" :: waited 0.027s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5617b9-e475-4a34-aae8-872f9db53e2d]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402" returned: 0 in 0.530s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a745f12f-3de6-4f7f-863d-af3ec99f8402" returned: 0 in 0.132s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Lock "cinder-quobyte-a745f12f-3de6-4f7f-863d-af3ec99f8402" released by "delete_volume" :: held 0.877s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:07 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Created reservations ['675de610-5567-432d-bb05-84cc61b09de0', '39e42e4c-5e12-4b90-adeb-21f48263a33d', '21ea6668-39aa-411d-88a6-0db5351f2c7b', '88b5454d-7980-4d78-bbf1-07649bead497'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.123s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:07 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:37:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Deleted volume successfully.
Sep 10 19:37:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-13109c7b-db41-4153-8f4e-f0a474c2fbdd tempest-SnapshotsActionsTest-321923239 None] Lock "cinder-a745f12f-3de6-4f7f-863d-af3ec99f8402-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:37:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.125s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.296s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:37:17 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:DELETE=1,cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:37:18 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:INSERT=24,cinder:UPDATE=77,cinder:DELETE=7,cinder:SELECT=69 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:37:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:37:45 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:45 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:37:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Flow 'volume_create_manager' (42941fed-c7c8-406c-8cd0-28c88f15408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2930e6-0b9d-4ff4-ae5a-f3dcaace3943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2930e6-0b9d-4ff4-ae5a-f3dcaace3943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1262104702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f522cf-1d78-4186-9240-e3d0c6b0c6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c7a592f36454652ab4954adca910adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:46Z,use_quota=True,user_id='e759dc2c0ca94b1db8b020c2281123c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f323ce-b91e-41e5-bdfa-714ba1de42fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f323ce-b91e-41e5-bdfa-714ba1de42fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0923f2b-12cb-40c8-9f49-db293422896f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0923f2b-12cb-40c8-9f49-db293422896f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f522cf-1d78-4186-9240-e3d0c6b0c6a8', 'volume_name': 'volume-18f522cf-1d78-4186-9240-e3d0c6b0c6a8', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a565efc0-b608-484c-9fbf-2be927725df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a565efc0-b608-484c-9fbf-2be927725df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5638d331-188d-404a-a06e-7c28657374bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:46 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Volume 18f522cf-1d78-4186-9240-e3d0c6b0c6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f522cf-1d78-4186-9240-e3d0c6b0c6a8', 'volume_size': 1}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1262104702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f522cf-1d78-4186-9240-e3d0c6b0c6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c7a592f36454652ab4954adca910adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:46Z,use_quota=True,user_id='e759dc2c0ca94b1db8b020c2281123c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Creating volume 18f522cf-1d78-4186-9240-e3d0c6b0c6a8 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:37:46 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:37:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-18f522cf-1d78-4186-9240-e3d0c6b0c6a8 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:46 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=69, name=volume-18f522cf-1d78-4186-9240-e3d0c6b0c6a8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:37:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-18f522cf-1d78-4186-9240-e3d0c6b0c6a8 1073741824" returned: 0 in 0.814s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-18f522cf-1d78-4186-9240-e3d0c6b0c6a8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-18f522cf-1d78-4186-9240-e3d0c6b0c6a8" returned: 0 in 0.562s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] <== create_volume: return (1674ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:37:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5638d331-188d-404a-a06e-7c28657374bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f522cf-1d78-4186-9240-e3d0c6b0c6a8', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f0daec-878a-49a4-a272-6f485bbd2bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:48 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Volume volume-18f522cf-1d78-4186-9240-e3d0c6b0c6a8 (18f522cf-1d78-4186-9240-e3d0c6b0c6a8): created successfully
Sep 10 19:37:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f0daec-878a-49a4-a272-6f485bbd2bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Flow 'volume_create_manager' (42941fed-c7c8-406c-8cd0-28c88f15408b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:48 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-688a8b25-67f4-498a-a3f0-f19f2bbcf80b tempest-VolumeQuotasAdminTestJSON-877667346 None] Created volume successfully.
Sep 10 19:37:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Acquiring lock "cinder-18f522cf-1d78-4186-9240-e3d0c6b0c6a8-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Lock "cinder-18f522cf-1d78-4186-9240-e3d0c6b0c6a8-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:48 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Acquiring lock "cinder-quobyte-18f522cf-1d78-4186-9240-e3d0c6b0c6a8" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Lock "cinder-quobyte-18f522cf-1d78-4186-9240-e3d0c6b0c6a8" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:48 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbe6c30-5d5c-4ca3-ba28-a93e81e7447a]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-18f522cf-1d78-4186-9240-e3d0c6b0c6a8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-18f522cf-1d78-4186-9240-e3d0c6b0c6a8" returned: 0 in 0.658s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-18f522cf-1d78-4186-9240-e3d0c6b0c6a8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-18f522cf-1d78-4186-9240-e3d0c6b0c6a8" returned: 0 in 0.157s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Lock "cinder-quobyte-18f522cf-1d78-4186-9240-e3d0c6b0c6a8" released by "delete_volume" :: held 1.121s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:50 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Created reservations ['1060e089-0c95-4ac2-9783-d3f8eab39662', '67264d71-b5b2-4965-b6ba-95fa9a86c162', '9e313930-f4d8-4386-a499-f957113c7a18', '7e12bb7e-1a36-4e54-8817-acda31502c6c'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.137s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:50 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:37:51 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Deleted volume successfully.
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c7645ad3-3b88-4cff-8a40-cad6e995c492 tempest-VolumeQuotasAdminTestJSON-877667346 None] Lock "cinder-18f522cf-1d78-4186-9240-e3d0c6b0c6a8-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:51 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Flow 'volume_create_manager' (f9e3bac4-f45b-438f-95ec-495b6c77c01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10caf637-48c3-4000-812a-a681940da1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10caf637-48c3-4000-812a-a681940da1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-623973891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55bbf3c-cd91-4665-b574-ab814a442d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ff0f6d6ffb434887cc5f773bd26c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:51Z,use_quota=True,user_id='f7d79af3f50a4d918a66776a74e74106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0af0b57-1b46-4655-b612-d0bc583cee35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0af0b57-1b46-4655-b612-d0bc583cee35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09792305-024d-4135-89d5-474022ba26e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09792305-024d-4135-89d5-474022ba26e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a55bbf3c-cd91-4665-b574-ab814a442d48', 'volume_name': 'volume-a55bbf3c-cd91-4665-b574-ab814a442d48', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5e701d-7292-49b0-98b8-acc47100dd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5e701d-7292-49b0-98b8-acc47100dd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d8fa8c-644e-45aa-9a8c-210586f63e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:51 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume a55bbf3c-cd91-4665-b574-ab814a442d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a55bbf3c-cd91-4665-b574-ab814a442d48', 'volume_size': 1}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-623973891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55bbf3c-cd91-4665-b574-ab814a442d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ff0f6d6ffb434887cc5f773bd26c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:51Z,use_quota=True,user_id='f7d79af3f50a4d918a66776a74e74106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Creating volume a55bbf3c-cd91-4665-b574-ab814a442d48 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:37:51 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:37:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a55bbf3c-cd91-4665-b574-ab814a442d48 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:52 devstack quobyte-client[82855]: System call of process 92086 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:37:52 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=70, name=volume-a55bbf3c-cd91-4665-b574-ab814a442d48, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:37:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a55bbf3c-cd91-4665-b574-ab814a442d48 1073741824" returned: 0 in 0.711s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a55bbf3c-cd91-4665-b574-ab814a442d48 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:52 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:52 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:37:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Flow 'volume_create_manager' (e0247e8a-47cd-4f36-94ef-36da8f566216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f119492-342c-4250-acbf-4c6028511a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:53 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Flow 'volume_create_manager' (d64b2190-027b-431e-8d77-89feaa0b6ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21161dde-bf26-4b59-b0a9-07f75d5e5544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f119492-342c-4250-acbf-4c6028511a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1188884343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93aaecc2-7d40-41dd-b859-937b4e8cb3da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c7a592f36454652ab4954adca910adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:52Z,use_quota=True,user_id='e759dc2c0ca94b1db8b020c2281123c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74d08ef-8bb2-4291-b31b-3cd3c4c9867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74d08ef-8bb2-4291-b31b-3cd3c4c9867d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da57512-f5a6-4d6f-8302-37f231a3cf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da57512-f5a6-4d6f-8302-37f231a3cf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93aaecc2-7d40-41dd-b859-937b4e8cb3da', 'volume_name': 'volume-93aaecc2-7d40-41dd-b859-937b4e8cb3da', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54aa803-0dcf-4fca-986b-b90ab0b0ae06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54aa803-0dcf-4fca-986b-b90ab0b0ae06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e5ed58-0375-42d0-9932-4678df8de601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:53 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Volume 93aaecc2-7d40-41dd-b859-937b4e8cb3da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93aaecc2-7d40-41dd-b859-937b4e8cb3da', 'volume_size': 1}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21161dde-bf26-4b59-b0a9-07f75d5e5544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1334439064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d512c084-bcb5-4403-9dd1-da4a9b1ba508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ff0f6d6ffb434887cc5f773bd26c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:52Z,use_quota=True,user_id='f7d79af3f50a4d918a66776a74e74106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933b0710-dd08-49a8-9a62-d5dc809146bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933b0710-dd08-49a8-9a62-d5dc809146bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf03c03-dc75-40c1-b970-c5b457e8ef1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf03c03-dc75-40c1-b970-c5b457e8ef1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd512c084-bcb5-4403-9dd1-da4a9b1ba508', 'volume_name': 'volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a739a3-44a8-4653-9cb7-7b74afc20a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a739a3-44a8-4653-9cb7-7b74afc20a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57c7091-6a71-414e-b45e-7e350ba6786c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:53 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume d512c084-bcb5-4403-9dd1-da4a9b1ba508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508', 'volume_size': 1}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a55bbf3c-cd91-4665-b574-ab814a442d48" returned: 0 in 0.609s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] <== create_volume: return (1345ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1188884343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93aaecc2-7d40-41dd-b859-937b4e8cb3da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c7a592f36454652ab4954adca910adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:52Z,use_quota=True,user_id='e759dc2c0ca94b1db8b020c2281123c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Creating volume 93aaecc2-7d40-41dd-b859-937b4e8cb3da {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:37:53 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93aaecc2-7d40-41dd-b859-937b4e8cb3da 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:53 devstack quobyte-client[82855]: System call of process 92090 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:37:53 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=71, name=volume-93aaecc2-7d40-41dd-b859-937b4e8cb3da, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d8fa8c-644e-45aa-9a8c-210586f63e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a55bbf3c-cd91-4665-b574-ab814a442d48', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6eb1718-819e-4fdf-a17e-6b222487d83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93aaecc2-7d40-41dd-b859-937b4e8cb3da 1073741824" returned: 0 in 0.449s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93aaecc2-7d40-41dd-b859-937b4e8cb3da {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:53 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume volume-a55bbf3c-cd91-4665-b574-ab814a442d48 (a55bbf3c-cd91-4665-b574-ab814a442d48): created successfully
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6eb1718-819e-4fdf-a17e-6b222487d83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Flow 'volume_create_manager' (f9e3bac4-f45b-438f-95ec-495b6c77c01d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93aaecc2-7d40-41dd-b859-937b4e8cb3da" returned: 0 in 0.358s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] <== create_volume: return (825ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.880s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1334439064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d512c084-bcb5-4403-9dd1-da4a9b1ba508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ff0f6d6ffb434887cc5f773bd26c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:52Z,use_quota=True,user_id='f7d79af3f50a4d918a66776a74e74106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Creating volume d512c084-bcb5-4403-9dd1-da4a9b1ba508 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:37:54 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:54 devstack quobyte-client[82855]: System call of process 92094 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:37:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9b1ef5fa-588a-4085-b7ca-adac0e9f98d7 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Created volume successfully.
Sep 10 19:37:54 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=72, name=volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e5ed58-0375-42d0-9932-4678df8de601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93aaecc2-7d40-41dd-b859-937b4e8cb3da', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b472e086-4c7c-478b-9473-541f1a5d7e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508 1073741824" returned: 0 in 0.493s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:54 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Volume volume-93aaecc2-7d40-41dd-b859-937b4e8cb3da (93aaecc2-7d40-41dd-b859-937b4e8cb3da): created successfully
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b472e086-4c7c-478b-9473-541f1a5d7e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Flow 'volume_create_manager' (e0247e8a-47cd-4f36-94ef-36da8f566216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508" returned: 0 in 0.395s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] <== create_volume: return (914ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:37:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:55 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-dbe284e8-2b8c-4f82-85b7-ce4afe604a74 tempest-VolumeQuotasAdminTestJSON-877667346 None] Created volume successfully.
Sep 10 19:37:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57c7091-6a71-414e-b45e-7e350ba6786c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86532a0a-6b21-4730-b96e-70ad4898fb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:55 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508 (d512c084-bcb5-4403-9dd1-da4a9b1ba508): created successfully
Sep 10 19:37:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86532a0a-6b21-4730-b96e-70ad4898fb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Flow 'volume_create_manager' (d64b2190-027b-431e-8d77-89feaa0b6ecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:55 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-39defade-6c57-4955-9a43-7056fb17e01a tempest-TestServerVolumeAttachmentScenario-1398570564 None] Created volume successfully.
Sep 10 19:37:56 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-f7eb691f-0b07-44a9-94cb-8ff8dd3de9fc tempest-VolumeQuotasAdminTestJSON-1844226064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:56 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f7eb691f-0b07-44a9-94cb-8ff8dd3de9fc tempest-VolumeQuotasAdminTestJSON-1844226064 None] Transfer volume completed successfully.
Sep 10 19:37:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Acquiring lock "cinder-93aaecc2-7d40-41dd-b859-937b4e8cb3da-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Lock "cinder-93aaecc2-7d40-41dd-b859-937b4e8cb3da-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:58 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Acquiring lock "cinder-quobyte-93aaecc2-7d40-41dd-b859-937b4e8cb3da" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Lock "cinder-quobyte-93aaecc2-7d40-41dd-b859-937b4e8cb3da" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:58 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48858ff-5ec4-42a9-9565-4b44d40239c0]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93aaecc2-7d40-41dd-b859-937b4e8cb3da {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Acquiring lock "cinder-469505d4-e82d-41fa-b5eb-0c776c8fc3f2-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93aaecc2-7d40-41dd-b859-937b4e8cb3da" returned: 0 in 0.764s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93aaecc2-7d40-41dd-b859-937b4e8cb3da {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "cinder-469505d4-e82d-41fa-b5eb-0c776c8fc3f2-delete_volume" acquired by "delete_volume" :: waited 0.224s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93aaecc2-7d40-41dd-b859-937b4e8cb3da" returned: 0 in 0.303s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Lock "cinder-quobyte-93aaecc2-7d40-41dd-b859-937b4e8cb3da" released by "delete_volume" :: held 1.153s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:59 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Acquiring lock "cinder-quobyte-469505d4-e82d-41fa-b5eb-0c776c8fc3f2" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "cinder-quobyte-469505d4-e82d-41fa-b5eb-0c776c8fc3f2" acquired by "delete_volume" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df6ce11-2ee0-4277-997a-6663d879ee83]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-469505d4-e82d-41fa-b5eb-0c776c8fc3f2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:00 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Created reservations ['b463f8b5-0b7b-4fad-8d18-902c165226fa', '739fcab7-0f09-4e2a-8206-89d7b5f5d755', '6eca0d3b-4623-4cbf-b365-b6e904109b69', '574bd02d-404e-47f4-9f90-d9933e3a5e45'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-469505d4-e82d-41fa-b5eb-0c776c8fc3f2" returned: 0 in 0.571s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-469505d4-e82d-41fa-b5eb-0c776c8fc3f2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-469505d4-e82d-41fa-b5eb-0c776c8fc3f2" returned: 0 in 0.345s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "cinder-quobyte-469505d4-e82d-41fa-b5eb-0c776c8fc3f2" released by "delete_volume" :: held 1.239s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.517s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:01 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:38:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Deleted volume successfully.
Sep 10 19:38:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f8fead9-2791-41a1-817e-dfda3bdfef34 tempest-VolumeQuotasAdminTestJSON-371895207 None] Lock "cinder-93aaecc2-7d40-41dd-b859-937b4e8cb3da-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:01 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Created reservations ['6be01f58-b6b3-44bf-86e3-f54c190f5e91', '4b5e5674-1353-40a0-94a1-e0cfc8071bf7', 'f704ce3e-265a-4055-9a4a-64be97eb7971', '12d30cd9-4996-4a19-83bf-af6c7eb05703'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.111s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:01 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:38:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Deleted volume successfully.
Sep 10 19:38:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d8d9df39-84fd-4a74-89aa-307a7403aa08 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "cinder-469505d4-e82d-41fa-b5eb-0c776c8fc3f2-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Acquiring lock "cinder-a111e336-120b-4336-adbf-2c4a76a32a20-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "cinder-a111e336-120b-4336-adbf-2c4a76a32a20-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Acquiring lock "cinder-quobyte-a111e336-120b-4336-adbf-2c4a76a32a20" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "cinder-quobyte-a111e336-120b-4336-adbf-2c4a76a32a20" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:02 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a310d7e0-f88d-400a-9bc7-bc484bed47c9]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:38:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a111e336-120b-4336-adbf-2c4a76a32a20 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a111e336-120b-4336-adbf-2c4a76a32a20" returned: 0 in 0.664s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a111e336-120b-4336-adbf-2c4a76a32a20 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a111e336-120b-4336-adbf-2c4a76a32a20" returned: 0 in 0.142s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "cinder-quobyte-a111e336-120b-4336-adbf-2c4a76a32a20" released by "delete_volume" :: held 1.055s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:04 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Created reservations ['57a5986e-f79b-4deb-ba3d-5e817b079a03', '90f54df6-38cd-4779-ab98-dff7cdea6518', 'dc65c43a-8a67-43ad-8412-de22f76ec60f', '4e97cda9-3e94-440b-91b8-49d8bbe6d6f2'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.155s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:04 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:38:04 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Deleted volume successfully.
Sep 10 19:38:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-819a4159-3d6e-4776-b9b6-97df4bc0b5c2 tempest-AttachVolumeShelveTestJSON-254880779 None] Lock "cinder-a111e336-120b-4336-adbf-2c4a76a32a20-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:38:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.227s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:14 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=26,cinder:DELETE=3,cinder:SELECT=24,cinder:INSERT=4 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:38:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:38:15 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=25,cinder:UPDATE=54,cinder:INSERT=12,cinder:DELETE=5 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:38:16 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:16 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:38:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Flow 'volume_create_manager' (2d09ac19-e763-4996-97c3-26f3e4d696d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:38:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9814de-813a-46c4-a34f-dbe078767bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9814de-813a-46c4-a34f-dbe078767bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-14435952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=156235d7-0a23-4264-b21e-327c3b77c688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47970d23571d4eb799928b27a3478ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:38:17Z,use_quota=True,user_id='e362f9cc1f794bcabeca5e5e5a3003ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4db4ad-c192-45ea-b42a-46af7ac7501b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4db4ad-c192-45ea-b42a-46af7ac7501b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a37ebad-850d-4193-8448-f7046717a9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a37ebad-850d-4193-8448-f7046717a9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '156235d7-0a23-4264-b21e-327c3b77c688', 'volume_name': 'volume-156235d7-0a23-4264-b21e-327c3b77c688', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df7776b-fb0b-467e-b9fe-aefb167e58d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df7776b-fb0b-467e-b9fe-aefb167e58d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542ae87a-c7cb-4888-9c03-6516f072eaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:17 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Volume 156235d7-0a23-4264-b21e-327c3b77c688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-156235d7-0a23-4264-b21e-327c3b77c688', 'volume_size': 1}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-14435952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=156235d7-0a23-4264-b21e-327c3b77c688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47970d23571d4eb799928b27a3478ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:38:17Z,use_quota=True,user_id='e362f9cc1f794bcabeca5e5e5a3003ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Creating volume 156235d7-0a23-4264-b21e-327c3b77c688 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:38:17 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-156235d7-0a23-4264-b21e-327c3b77c688 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:17 devstack quobyte-client[82855]: System call of process 92176 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:38:17 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=73, name=volume-156235d7-0a23-4264-b21e-327c3b77c688, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-156235d7-0a23-4264-b21e-327c3b77c688 1073741824" returned: 0 in 0.462s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-156235d7-0a23-4264-b21e-327c3b77c688 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-156235d7-0a23-4264-b21e-327c3b77c688" returned: 0 in 0.127s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] <== create_volume: return (689ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542ae87a-c7cb-4888-9c03-6516f072eaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-156235d7-0a23-4264-b21e-327c3b77c688', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ecc1fc-505a-44d4-b033-3c16e512ce2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:17 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Volume volume-156235d7-0a23-4264-b21e-327c3b77c688 (156235d7-0a23-4264-b21e-327c3b77c688): created successfully
Sep 10 19:38:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ecc1fc-505a-44d4-b033-3c16e512ce2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Flow 'volume_create_manager' (2d09ac19-e763-4996-97c3-26f3e4d696d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:38:18 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-28d5f63a-5640-4151-b927-16cd55df281f tempest-VolumeQuotasNegativeTestJSON-683366557 None] Created volume successfully.
Sep 10 19:38:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Acquiring lock "cinder-156235d7-0a23-4264-b21e-327c3b77c688-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Lock "cinder-156235d7-0a23-4264-b21e-327c3b77c688-delete_volume" acquired by "delete_volume" :: waited 0.161s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:21 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Acquiring lock "cinder-quobyte-156235d7-0a23-4264-b21e-327c3b77c688" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Lock "cinder-quobyte-156235d7-0a23-4264-b21e-327c3b77c688" acquired by "delete_volume" :: waited 0.025s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:21 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[407ea61f-e987-402e-ad55-f4135c861c11]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:38:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-156235d7-0a23-4264-b21e-327c3b77c688 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:23 devstack quobyte-client[82855]: System call of process 92221 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:38:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-156235d7-0a23-4264-b21e-327c3b77c688" returned: 0 in 1.731s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-156235d7-0a23-4264-b21e-327c3b77c688 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-156235d7-0a23-4264-b21e-327c3b77c688" returned: 0 in 0.290s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Lock "cinder-quobyte-156235d7-0a23-4264-b21e-327c3b77c688" released by "delete_volume" :: held 2.410s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:24 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Created reservations ['551830ee-f435-456e-b944-f7ab4cbc7b7c', 'f30f0f71-3a9e-43bf-8e70-a2d69b323e24', 'd6c57303-c4ee-4db6-818d-1a0251c36029', 'c3949505-5fe4-481a-a702-6d3c08d41547'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.156s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:25 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:38:25 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Deleted volume successfully.
Sep 10 19:38:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-302ab6a6-b738-4261-992f-1b8fa0936e04 tempest-VolumeQuotasNegativeTestJSON-683366557 None] Lock "cinder-156235d7-0a23-4264-b21e-327c3b77c688-delete_volume" released by "delete_volume" :: held 4.706s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=6,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=4 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:38:35 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:38:38 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Flow 'volume_create_manager' (69c969a3-1342-4376-b047-74b16092303d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc8f450-b32e-4430-b500-fbe72dbcb6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc8f450-b32e-4430-b500-fbe72dbcb6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1291136092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571dd3b9-883e-4211-9329-851df0dc8102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4bb6801dcb24af1ba9ca0257f5696a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:38:38Z,use_quota=True,user_id='3d7443444b024bc58205ffac2f3c3835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06285be6-c5cf-4d9c-91d4-9aa2d11f1919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06285be6-c5cf-4d9c-91d4-9aa2d11f1919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf26ee1-737a-487e-945b-d8bc47b6eb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf26ee1-737a-487e-945b-d8bc47b6eb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '571dd3b9-883e-4211-9329-851df0dc8102', 'volume_name': 'volume-571dd3b9-883e-4211-9329-851df0dc8102', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52066821-db61-43db-84e2-d3ec37e1ba89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52066821-db61-43db-84e2-d3ec37e1ba89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716d52fe-5114-475c-9e70-3dec0af00386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:38 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Volume 571dd3b9-883e-4211-9329-851df0dc8102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-571dd3b9-883e-4211-9329-851df0dc8102', 'volume_size': 1}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1291136092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571dd3b9-883e-4211-9329-851df0dc8102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4bb6801dcb24af1ba9ca0257f5696a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:38:38Z,use_quota=True,user_id='3d7443444b024bc58205ffac2f3c3835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Creating volume 571dd3b9-883e-4211-9329-851df0dc8102 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:38:38 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:38:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-571dd3b9-883e-4211-9329-851df0dc8102 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:39 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=74, name=volume-571dd3b9-883e-4211-9329-851df0dc8102, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:38:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-571dd3b9-883e-4211-9329-851df0dc8102 1073741824" returned: 0 in 0.457s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-571dd3b9-883e-4211-9329-851df0dc8102 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-571dd3b9-883e-4211-9329-851df0dc8102" returned: 0 in 0.102s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] <== create_volume: return (683ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:38:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716d52fe-5114-475c-9e70-3dec0af00386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571dd3b9-883e-4211-9329-851df0dc8102', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cef7939-3e32-4749-ac47-4afaf5d5ee79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:40 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Volume volume-571dd3b9-883e-4211-9329-851df0dc8102 (571dd3b9-883e-4211-9329-851df0dc8102): created successfully
Sep 10 19:38:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cef7939-3e32-4749-ac47-4afaf5d5ee79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Flow 'volume_create_manager' (69c969a3-1342-4376-b047-74b16092303d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:38:40 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-00d1ef09-962f-4e52-a8da-bc136a46b8c4 tempest-VolumesServicesTestJSON-335320740 None] Created volume successfully.
Sep 10 19:38:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Acquiring lock "cinder-571dd3b9-883e-4211-9329-851df0dc8102-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Lock "cinder-571dd3b9-883e-4211-9329-851df0dc8102-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:41 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Acquiring lock "cinder-quobyte-571dd3b9-883e-4211-9329-851df0dc8102" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Lock "cinder-quobyte-571dd3b9-883e-4211-9329-851df0dc8102" acquired by "delete_volume" :: waited 0.029s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:41 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d320e562-d947-432c-9085-d1839b4763da]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:38:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-571dd3b9-883e-4211-9329-851df0dc8102 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-571dd3b9-883e-4211-9329-851df0dc8102" returned: 0 in 1.003s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-571dd3b9-883e-4211-9329-851df0dc8102 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-571dd3b9-883e-4211-9329-851df0dc8102" returned: 0 in 0.128s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Lock "cinder-quobyte-571dd3b9-883e-4211-9329-851df0dc8102" released by "delete_volume" :: held 1.464s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:44 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Created reservations ['5f57bf5a-04ce-46dd-a3c1-a71822678dae', '6c566359-c3c6-43f4-b3f1-ee8be46c48e5', '8003501c-90d1-4d8f-8750-118d991b2db0', '85233762-61f4-46e0-aca0-a7c72e314f22'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.247s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:44 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:38:45 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Deleted volume successfully.
Sep 10 19:38:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2a962d3f-fa71-46bf-b095-42cc1374832e tempest-VolumesServicesTestJSON-335320740 None] Lock "cinder-571dd3b9-883e-4211-9329-851df0dc8102-delete_volume" released by "delete_volume" :: held 3.912s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:54 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=8,cinder:DELETE=1,cinder:INSERT=4,cinder:UPDATE=11 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:38:55 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:39:07 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Flow 'volume_create_manager' (6fbcef9d-298b-4eda-8c0c-f054d6ee7682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e97351-ff33-4212-92d9-e7dd817c526f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e97351-ff33-4212-92d9-e7dd817c526f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1223026078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940bc2fc-88bc-41d0-aee7-66f69aee53b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6afb98c0a3a45219ed67ca9df6cc47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:07Z,use_quota=True,user_id='a5cb812904a24994925ef15625582abc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5fa874b-948b-477b-bfac-3a83c4948260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5fa874b-948b-477b-bfac-3a83c4948260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfa53ab-5ab2-4b31-a9ef-22945c906042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfa53ab-5ab2-4b31-a9ef-22945c906042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '940bc2fc-88bc-41d0-aee7-66f69aee53b7', 'volume_name': 'volume-940bc2fc-88bc-41d0-aee7-66f69aee53b7', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3920b98f-aedb-4700-9c63-f01c9ebbcdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3920b98f-aedb-4700-9c63-f01c9ebbcdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b490e44-20e2-43b1-9d5d-ffe57a2fed0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:07 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Volume 940bc2fc-88bc-41d0-aee7-66f69aee53b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-940bc2fc-88bc-41d0-aee7-66f69aee53b7', 'volume_size': 1}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1223026078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940bc2fc-88bc-41d0-aee7-66f69aee53b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6afb98c0a3a45219ed67ca9df6cc47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:07Z,use_quota=True,user_id='a5cb812904a24994925ef15625582abc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Creating volume 940bc2fc-88bc-41d0-aee7-66f69aee53b7 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:39:07 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:39:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-940bc2fc-88bc-41d0-aee7-66f69aee53b7 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:07 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=75, name=volume-940bc2fc-88bc-41d0-aee7-66f69aee53b7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:39:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-940bc2fc-88bc-41d0-aee7-66f69aee53b7 1073741824" returned: 0 in 0.689s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-940bc2fc-88bc-41d0-aee7-66f69aee53b7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-940bc2fc-88bc-41d0-aee7-66f69aee53b7" returned: 0 in 0.390s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] <== create_volume: return (1265ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:39:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b490e44-20e2-43b1-9d5d-ffe57a2fed0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-940bc2fc-88bc-41d0-aee7-66f69aee53b7', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd39d15e-9595-440d-8c00-7bf8514b168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:09 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Volume volume-940bc2fc-88bc-41d0-aee7-66f69aee53b7 (940bc2fc-88bc-41d0-aee7-66f69aee53b7): created successfully
Sep 10 19:39:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd39d15e-9595-440d-8c00-7bf8514b168d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Flow 'volume_create_manager' (6fbcef9d-298b-4eda-8c0c-f054d6ee7682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:09 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f517781b-b5d1-4c60-8a3b-5aaedc673b55 tempest-VolumesListAdminTestJSON-1286435983 None] Created volume successfully.
Sep 10 19:39:10 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Flow 'volume_create_manager' (0c3331e1-b6a3-46f0-ab0b-0e534384585a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09842f28-55c9-4a6b-b049-ac2e3bf2e71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09842f28-55c9-4a6b-b049-ac2e3bf2e71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1110657813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac830d3-f344-42a6-94fe-51dad41a3d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6afb98c0a3a45219ed67ca9df6cc47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:11Z,use_quota=True,user_id='a5cb812904a24994925ef15625582abc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe78156f-fd27-4701-8a11-ee52f86e09ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe78156f-fd27-4701-8a11-ee52f86e09ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3577e9e6-fdba-4571-a5d0-f6e8ccfbc0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3577e9e6-fdba-4571-a5d0-f6e8ccfbc0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac830d3-f344-42a6-94fe-51dad41a3d87', 'volume_name': 'volume-4ac830d3-f344-42a6-94fe-51dad41a3d87', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a0963d-f44c-4dbf-bb55-9460fb4ed21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a0963d-f44c-4dbf-bb55-9460fb4ed21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09816542-a41a-441d-afe3-73a679640de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:10 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Volume 4ac830d3-f344-42a6-94fe-51dad41a3d87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac830d3-f344-42a6-94fe-51dad41a3d87', 'volume_size': 1}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1110657813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac830d3-f344-42a6-94fe-51dad41a3d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6afb98c0a3a45219ed67ca9df6cc47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:11Z,use_quota=True,user_id='a5cb812904a24994925ef15625582abc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Creating volume 4ac830d3-f344-42a6-94fe-51dad41a3d87 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:39:10 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:39:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4ac830d3-f344-42a6-94fe-51dad41a3d87 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:11 devstack quobyte-client[82855]: System call of process 92449 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:39:11 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=76, name=volume-4ac830d3-f344-42a6-94fe-51dad41a3d87, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:39:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4ac830d3-f344-42a6-94fe-51dad41a3d87 1073741824" returned: 0 in 0.326s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4ac830d3-f344-42a6-94fe-51dad41a3d87 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4ac830d3-f344-42a6-94fe-51dad41a3d87" returned: 0 in 0.097s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] <== create_volume: return (484ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:39:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.525s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09816542-a41a-441d-afe3-73a679640de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac830d3-f344-42a6-94fe-51dad41a3d87', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb13727-11c1-454e-aa3d-88d6412391b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:11 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Volume volume-4ac830d3-f344-42a6-94fe-51dad41a3d87 (4ac830d3-f344-42a6-94fe-51dad41a3d87): created successfully
Sep 10 19:39:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb13727-11c1-454e-aa3d-88d6412391b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Flow 'volume_create_manager' (0c3331e1-b6a3-46f0-ab0b-0e534384585a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:11 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-57ff5f2c-96f8-4aab-8dfa-d924a89f4823 tempest-VolumesListAdminTestJSON-1286435983 None] Created volume successfully.
Sep 10 19:39:13 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:13 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:39:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Flow 'volume_create_manager' (018ec576-8d87-4af0-85e8-1994da9a8965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47c97b4-c656-4260-af77-737047557357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47c97b4-c656-4260-af77-737047557357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-472635099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed649f6-1f6b-40ee-b4b4-066083409808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6afb98c0a3a45219ed67ca9df6cc47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:14Z,use_quota=True,user_id='a5cb812904a24994925ef15625582abc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd523b08-6201-41e9-aa89-30a3dbb26ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd523b08-6201-41e9-aa89-30a3dbb26ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1c3fcf-ef8a-4ba7-ab69-a4abcef84c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1c3fcf-ef8a-4ba7-ab69-a4abcef84c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed649f6-1f6b-40ee-b4b4-066083409808', 'volume_name': 'volume-3ed649f6-1f6b-40ee-b4b4-066083409808', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c04bd77-8abc-44b6-9dbb-e582870528d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c04bd77-8abc-44b6-9dbb-e582870528d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1e107d-6df0-41cc-9931-0e161ddc47fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:14 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Volume 3ed649f6-1f6b-40ee-b4b4-066083409808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed649f6-1f6b-40ee-b4b4-066083409808', 'volume_size': 1}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-472635099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed649f6-1f6b-40ee-b4b4-066083409808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6afb98c0a3a45219ed67ca9df6cc47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:14Z,use_quota=True,user_id='a5cb812904a24994925ef15625582abc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Creating volume 3ed649f6-1f6b-40ee-b4b4-066083409808 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:39:14 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3ed649f6-1f6b-40ee-b4b4-066083409808 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:14 devstack quobyte-client[82855]: System call of process 92458 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:39:14 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=77, name=volume-3ed649f6-1f6b-40ee-b4b4-066083409808, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.212s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:39:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3ed649f6-1f6b-40ee-b4b4-066083409808 1073741824" returned: 0 in 1.008s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3ed649f6-1f6b-40ee-b4b4-066083409808 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3ed649f6-1f6b-40ee-b4b4-066083409808" returned: 0 in 0.158s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] <== create_volume: return (1269ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:39:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1e107d-6df0-41cc-9931-0e161ddc47fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed649f6-1f6b-40ee-b4b4-066083409808', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306c2f97-8360-4458-bf17-5ff72230aad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:15 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Volume volume-3ed649f6-1f6b-40ee-b4b4-066083409808 (3ed649f6-1f6b-40ee-b4b4-066083409808): created successfully
Sep 10 19:39:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306c2f97-8360-4458-bf17-5ff72230aad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Flow 'volume_create_manager' (018ec576-8d87-4af0-85e8-1994da9a8965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-69be5679-cce3-4091-a16b-694223044074 tempest-VolumesListAdminTestJSON-1286435983 None] Created volume successfully.
Sep 10 19:39:17 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:17 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Flow 'volume_create_manager' (90c1977e-421a-4676-b709-bb5a13a4d2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1203387d-30b0-4c9c-a40b-cf7f3d1265d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1203387d-30b0-4c9c-a40b-cf7f3d1265d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd3320b-3c8d-405c-9ce7-4a59264b85cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85dd6c3ede9e49bd9f1fb1ebe5ffcaea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:17Z,use_quota=True,user_id='55e1e0e2ceca4e8280a36923783b336b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20036491-587e-4e06-8164-dac952800afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20036491-587e-4e06-8164-dac952800afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d86311-376f-4e34-be71-5c8bc41bea5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d86311-376f-4e34-be71-5c8bc41bea5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd3320b-3c8d-405c-9ce7-4a59264b85cd', 'volume_name': 'volume-0cd3320b-3c8d-405c-9ce7-4a59264b85cd', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8882b974-909d-4ad9-8861-7d15f0d8219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8882b974-909d-4ad9-8861-7d15f0d8219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ce7ef4-c32f-4f91-b716-91211e520051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:18 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Volume 0cd3320b-3c8d-405c-9ce7-4a59264b85cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd3320b-3c8d-405c-9ce7-4a59264b85cd', 'volume_size': 1}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd3320b-3c8d-405c-9ce7-4a59264b85cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85dd6c3ede9e49bd9f1fb1ebe5ffcaea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:17Z,use_quota=True,user_id='55e1e0e2ceca4e8280a36923783b336b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Creating volume 0cd3320b-3c8d-405c-9ce7-4a59264b85cd {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:39:18 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:39:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0cd3320b-3c8d-405c-9ce7-4a59264b85cd 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:19 devstack quobyte-client[82855]: System call of process 92473 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:39:19 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=78, name=volume-0cd3320b-3c8d-405c-9ce7-4a59264b85cd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:39:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0cd3320b-3c8d-405c-9ce7-4a59264b85cd 1073741824" returned: 0 in 0.694s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0cd3320b-3c8d-405c-9ce7-4a59264b85cd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0cd3320b-3c8d-405c-9ce7-4a59264b85cd" returned: 0 in 0.227s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] <== create_volume: return (1233ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:39:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ce7ef4-c32f-4f91-b716-91211e520051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd3320b-3c8d-405c-9ce7-4a59264b85cd', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c1c86b-2ce4-4796-8631-c4ca6ea0a4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:20 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Volume volume-0cd3320b-3c8d-405c-9ce7-4a59264b85cd (0cd3320b-3c8d-405c-9ce7-4a59264b85cd): created successfully
Sep 10 19:39:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c1c86b-2ce4-4796-8631-c4ca6ea0a4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Flow 'volume_create_manager' (90c1977e-421a-4676-b709-bb5a13a4d2f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:20 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2660da87-bdd0-4823-b697-8cbe8e47af19 tempest-VolumesListAdminTestJSON-467617036 None] Created volume successfully.
Sep 10 19:39:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Acquiring lock "cinder-0cd3320b-3c8d-405c-9ce7-4a59264b85cd-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Lock "cinder-0cd3320b-3c8d-405c-9ce7-4a59264b85cd-delete_volume" acquired by "delete_volume" :: waited 0.252s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Acquiring lock "cinder-3ed649f6-1f6b-40ee-b4b4-066083409808-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "cinder-3ed649f6-1f6b-40ee-b4b4-066083409808-delete_volume" acquired by "delete_volume" :: waited 0.390s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:22 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Acquiring lock "cinder-quobyte-0cd3320b-3c8d-405c-9ce7-4a59264b85cd" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Lock "cinder-quobyte-0cd3320b-3c8d-405c-9ce7-4a59264b85cd" acquired by "delete_volume" :: waited 0.059s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:22 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Acquiring lock "cinder-quobyte-3ed649f6-1f6b-40ee-b4b4-066083409808" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:22 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d896e2a2-ae5e-40c0-a9bc-d2520d8b308e]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:39:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0cd3320b-3c8d-405c-9ce7-4a59264b85cd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "cinder-quobyte-3ed649f6-1f6b-40ee-b4b4-066083409808" acquired by "delete_volume" :: waited 0.484s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:23 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c35141-fd5f-4e7f-8350-9c335803c4ca]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:39:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3ed649f6-1f6b-40ee-b4b4-066083409808 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:23 devstack quobyte-client[82855]: System call of process 92488 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:39:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0cd3320b-3c8d-405c-9ce7-4a59264b85cd" returned: 0 in 1.017s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0cd3320b-3c8d-405c-9ce7-4a59264b85cd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:24 devstack quobyte-client[82855]: System call of process 92490 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:39:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0cd3320b-3c8d-405c-9ce7-4a59264b85cd" returned: 0 in 0.480s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3ed649f6-1f6b-40ee-b4b4-066083409808" returned: 0 in 1.111s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3ed649f6-1f6b-40ee-b4b4-066083409808 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Lock "cinder-quobyte-0cd3320b-3c8d-405c-9ce7-4a59264b85cd" released by "delete_volume" :: held 1.960s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3ed649f6-1f6b-40ee-b4b4-066083409808" returned: 0 in 0.398s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "cinder-quobyte-3ed649f6-1f6b-40ee-b4b4-066083409808" released by "delete_volume" :: held 1.631s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Created reservations ['5a23f59c-38d2-4ab3-9788-786663196144', '4a92e1b5-cc06-442a-a78a-d2e1280c03af', '05267799-b521-4145-89f2-3548aa7b9f26', 'a80a741b-5985-4e4a-be04-6ff79d27f819'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Created reservations ['ce9a45a6-3d68-48be-b076-ea72e8b80dd1', 'da95318e-6fea-480b-ba72-044477844081', 'c45804e9-a229-49aa-9c92-51416abc694c', 'd39a96c1-e040-43a6-9ead-af28d6d693ec'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.224s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:39:25 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Deleted volume successfully.
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5bccbd72-f659-482d-9069-0212b62be5c1 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "cinder-3ed649f6-1f6b-40ee-b4b4-066083409808-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.135s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:25 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:39:26 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Deleted volume successfully.
Sep 10 19:39:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Acquiring lock "cinder-4ac830d3-f344-42a6-94fe-51dad41a3d87-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Lock "cinder-4ac830d3-f344-42a6-94fe-51dad41a3d87-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-dd890e1a-9f46-425b-a1ed-02a5691d5954 tempest-VolumesListAdminTestJSON-467617036 None] Lock "cinder-0cd3320b-3c8d-405c-9ce7-4a59264b85cd-delete_volume" released by "delete_volume" :: held 4.473s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:26 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Acquiring lock "cinder-quobyte-4ac830d3-f344-42a6-94fe-51dad41a3d87" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Lock "cinder-quobyte-4ac830d3-f344-42a6-94fe-51dad41a3d87" acquired by "delete_volume" :: waited 0.023s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:26 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d86fa3b-589e-48c2-8cd5-72533d302ded]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:39:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4ac830d3-f344-42a6-94fe-51dad41a3d87 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4ac830d3-f344-42a6-94fe-51dad41a3d87" returned: 0 in 0.976s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4ac830d3-f344-42a6-94fe-51dad41a3d87 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4ac830d3-f344-42a6-94fe-51dad41a3d87" returned: 0 in 0.165s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Lock "cinder-quobyte-4ac830d3-f344-42a6-94fe-51dad41a3d87" released by "delete_volume" :: held 1.382s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:28 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Created reservations ['26f9ee65-8021-42eb-8cb0-1b6081c6b11f', 'f73ce582-0124-410f-a7f6-54fe6b9c84f9', '873bc2bb-bcd8-47e1-bd05-0ee3dff75ed0', '077f85c4-7277-492a-8e74-9f1e8d0521ee'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:39:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.259s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:28 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:39:29 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Deleted volume successfully.
Sep 10 19:39:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Acquiring lock "cinder-940bc2fc-88bc-41d0-aee7-66f69aee53b7-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8e8d18f4-793e-4925-8bef-3f19720503ef tempest-VolumesListAdminTestJSON-1286435983 None] Lock "cinder-4ac830d3-f344-42a6-94fe-51dad41a3d87-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "cinder-940bc2fc-88bc-41d0-aee7-66f69aee53b7-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:29 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Acquiring lock "cinder-quobyte-940bc2fc-88bc-41d0-aee7-66f69aee53b7" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "cinder-quobyte-940bc2fc-88bc-41d0-aee7-66f69aee53b7" acquired by "delete_volume" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:29 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[92290f9a-7eb1-4ad2-97aa-40190da0b33a]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:39:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-940bc2fc-88bc-41d0-aee7-66f69aee53b7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-940bc2fc-88bc-41d0-aee7-66f69aee53b7" returned: 0 in 0.561s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-940bc2fc-88bc-41d0-aee7-66f69aee53b7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-940bc2fc-88bc-41d0-aee7-66f69aee53b7" returned: 0 in 0.236s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "cinder-quobyte-940bc2fc-88bc-41d0-aee7-66f69aee53b7" released by "delete_volume" :: held 0.992s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:30 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Created reservations ['5f42b7c3-363e-4c7e-a083-9bc9ef6016c6', 'b862b055-aa8d-451c-adc8-27ca68ba23ed', '2b5db2b0-69c4-4acf-a3ad-786c247d983e', 'b3641c78-4240-4ebf-ae63-080a982b3c4c'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:39:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.120s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:31 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:39:31 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Deleted volume successfully.
Sep 10 19:39:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-80e1f389-0a86-4140-b6a9-cf80453e22e5 tempest-VolumesListAdminTestJSON-1286435983 None] Lock "cinder-940bc2fc-88bc-41d0-aee7-66f69aee53b7-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:41 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=37,cinder:SELECT=26,cinder:DELETE=3,cinder:INSERT=10 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:39:41 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=23,cinder:UPDATE=44,cinder:DELETE=5,cinder:INSERT=6 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:39:43 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:43 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Flow 'volume_create_manager' (b8aecea0-8a40-490e-a2e0-fdec0e37e673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d5b1aa-b2ba-4939-9ec6-46ad22ba603f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d5b1aa-b2ba-4939-9ec6-46ad22ba603f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-757775468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6806b6-9148-4dd9-b027-d2ffe1133070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba72ae8666774805a8d293c70c4742fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:44Z,use_quota=True,user_id='eb220b82392745ec9587efb823a8a560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79becf5f-01c3-491a-ae3a-cea96fdaa3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79becf5f-01c3-491a-ae3a-cea96fdaa3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba53b9a6-58b6-4158-9695-3014ae53682e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba53b9a6-58b6-4158-9695-3014ae53682e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe6806b6-9148-4dd9-b027-d2ffe1133070', 'volume_name': 'volume-fe6806b6-9148-4dd9-b027-d2ffe1133070', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21528ab8-da3a-4f92-b888-e042ba5e787c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21528ab8-da3a-4f92-b888-e042ba5e787c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da96f91-27cb-4def-9d5d-47ca7b14b4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:44 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Volume fe6806b6-9148-4dd9-b027-d2ffe1133070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe6806b6-9148-4dd9-b027-d2ffe1133070', 'volume_size': 1}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-757775468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6806b6-9148-4dd9-b027-d2ffe1133070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba72ae8666774805a8d293c70c4742fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:44Z,use_quota=True,user_id='eb220b82392745ec9587efb823a8a560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Creating volume fe6806b6-9148-4dd9-b027-d2ffe1133070 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:39:44 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:39:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fe6806b6-9148-4dd9-b027-d2ffe1133070 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:44 devstack quobyte-client[82855]: System call of process 92532 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:39:44 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=79, name=volume-fe6806b6-9148-4dd9-b027-d2ffe1133070, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:39:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fe6806b6-9148-4dd9-b027-d2ffe1133070 1073741824" returned: 0 in 0.606s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fe6806b6-9148-4dd9-b027-d2ffe1133070 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fe6806b6-9148-4dd9-b027-d2ffe1133070" returned: 0 in 0.386s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] <== create_volume: return (1132ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:39:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da96f91-27cb-4def-9d5d-47ca7b14b4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6806b6-9148-4dd9-b027-d2ffe1133070', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613c0fa2-c7ec-470c-947a-60900c883a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:45 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Volume volume-fe6806b6-9148-4dd9-b027-d2ffe1133070 (fe6806b6-9148-4dd9-b027-d2ffe1133070): created successfully
Sep 10 19:39:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613c0fa2-c7ec-470c-947a-60900c883a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Flow 'volume_create_manager' (b8aecea0-8a40-490e-a2e0-fdec0e37e673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:45 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1f4ed918-0388-4398-8b98-2984bcd37be0 tempest-VolumesMetadataTest-899672337 None] Created volume successfully.
Sep 10 19:39:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-cfdffe00-a6a1-4278-ae09-87832db6e7c4 req-3c9b5a9a-b4e6-4b22-881e-748c5d955d6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-cfdffe00-a6a1-4278-ae09-87832db6e7c4 req-3c9b5a9a-b4e6-4b22-881e-748c5d955d6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:46 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2869483-fa9f-4dff-bee9-ab024df19cd4]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:39:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-cfdffe00-a6a1-4278-ae09-87832db6e7c4 req-3c9b5a9a-b4e6-4b22-881e-748c5d955d6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a55bbf3c-cd91-4665-b574-ab814a442d48 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:46 devstack quobyte-client[82855]: System call of process 92544 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:39:46 devstack quobyte-client[82855]: System call of process 92544 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:39:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-cfdffe00-a6a1-4278-ae09-87832db6e7c4 req-3c9b5a9a-b4e6-4b22-881e-748c5d955d6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a55bbf3c-cd91-4665-b574-ab814a442d48" returned: 0 in 0.630s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-cfdffe00-a6a1-4278-ae09-87832db6e7c4 req-3c9b5a9a-b4e6-4b22-881e-748c5d955d6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.694s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-cfdffe00-a6a1-4278-ae09-87832db6e7c4 req-3c9b5a9a-b4e6-4b22-881e-748c5d955d6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-a55bbf3c-cd91-4665-b574-ab814a442d48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56561bf1-8be2-4b32-8d68-668d821ebc86', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:39:47 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-cfdffe00-a6a1-4278-ae09-87832db6e7c4 req-3c9b5a9a-b4e6-4b22-881e-748c5d955d6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:47 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-cfdffe00-a6a1-4278-ae09-87832db6e7c4 req-3c9b5a9a-b4e6-4b22-881e-748c5d955d6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] attachment_update completed successfully.
Sep 10 19:39:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Acquiring lock "cinder-fe6806b6-9148-4dd9-b027-d2ffe1133070-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Lock "cinder-fe6806b6-9148-4dd9-b027-d2ffe1133070-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:48 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Acquiring lock "cinder-quobyte-fe6806b6-9148-4dd9-b027-d2ffe1133070" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Lock "cinder-quobyte-fe6806b6-9148-4dd9-b027-d2ffe1133070" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:48 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27434c7-3c21-49db-abde-ee1d5b40c933]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:39:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fe6806b6-9148-4dd9-b027-d2ffe1133070 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fe6806b6-9148-4dd9-b027-d2ffe1133070" returned: 0 in 0.502s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fe6806b6-9148-4dd9-b027-d2ffe1133070 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fe6806b6-9148-4dd9-b027-d2ffe1133070" returned: 0 in 0.115s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Lock "cinder-quobyte-fe6806b6-9148-4dd9-b027-d2ffe1133070" released by "delete_volume" :: held 0.835s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:50 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Created reservations ['5d4e4279-ce18-427e-9969-4a3f957be758', 'aaffa0c5-cbc4-42e0-bd7c-313cf34224b8', '37b71d18-531c-4bfb-b943-bde98f2b5d81', 'ee644caf-a913-45ff-83a3-f27b15cbc385'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:39:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.115s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:50 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:39:50 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Deleted volume successfully.
Sep 10 19:39:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8b714979-758e-45c0-8a40-406cc72a4470 tempest-VolumesMetadataTest-899672337 None] Lock "cinder-fe6806b6-9148-4dd9-b027-d2ffe1133070-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:56 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:56 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:39:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Flow 'volume_create_manager' (07e1484e-7bf4-4b1d-8122-9cd91e381b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ad360b-364c-4254-a982-21a12c07e434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ad360b-364c-4254-a982-21a12c07e434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1163146001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4fce46-1a99-4cd3-b9fb-80cfbe570f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62322d15d9804872893cf545017e7844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:57Z,use_quota=True,user_id='c5df3531e62b47de8a89c7032109376f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0d79c3-ed7c-4ef6-9e41-e22a10d4dac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0d79c3-ed7c-4ef6-9e41-e22a10d4dac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0aacc1-6af0-409f-8af7-b833d1867df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0aacc1-6af0-409f-8af7-b833d1867df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e4fce46-1a99-4cd3-b9fb-80cfbe570f88', 'volume_name': 'volume-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ba4d9d-6246-4a3d-8f6c-7b65bd950f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ba4d9d-6246-4a3d-8f6c-7b65bd950f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b9a28b-0bed-46c6-9de6-0e8bfa96f8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:57 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Volume 9e4fce46-1a99-4cd3-b9fb-80cfbe570f88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88', 'volume_size': 1}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1163146001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4fce46-1a99-4cd3-b9fb-80cfbe570f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62322d15d9804872893cf545017e7844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:57Z,use_quota=True,user_id='c5df3531e62b47de8a89c7032109376f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Creating volume 9e4fce46-1a99-4cd3-b9fb-80cfbe570f88 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:39:57 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:57 devstack quobyte-client[82855]: System call of process 92977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:39:57 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=80, name=volume-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88 1073741824" returned: 0 in 0.456s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88" returned: 0 in 0.184s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] <== create_volume: return (726ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:39:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b9a28b-0bed-46c6-9de6-0e8bfa96f8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3378a86b-ee35-4de3-878c-4cc0ed43ee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:58 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Volume volume-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88 (9e4fce46-1a99-4cd3-b9fb-80cfbe570f88): created successfully
Sep 10 19:39:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3378a86b-ee35-4de3-878c-4cc0ed43ee4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Flow 'volume_create_manager' (07e1484e-7bf4-4b1d-8122-9cd91e381b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-907e4f39-7e98-4c5e-9ddb-d71f738e3678 tempest-VolumesTransfersV357Test-1137225958 None] Created volume successfully.
Sep 10 19:39:59 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-1ea8fea4-2722-42c3-86da-2af74ac33d22 tempest-VolumesTransfersV357Test-2109528590 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1ea8fea4-2722-42c3-86da-2af74ac33d22 tempest-VolumesTransfersV357Test-2109528590 None] Transfer volume completed successfully.
Sep 10 19:40:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Acquiring lock "cinder-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:40:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Lock "cinder-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88-delete_volume" acquired by "delete_volume" :: waited 0.253s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:40:01 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:40:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Acquiring lock "cinder-quobyte-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:40:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Lock "cinder-quobyte-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:40:01 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dfac06-1553-4605-952d-ab09f83b81ff]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:40:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88" returned: 0 in 0.436s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88" returned: 0 in 0.259s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Lock "cinder-quobyte-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88" released by "delete_volume" :: held 0.818s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:40:02 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Created reservations ['f2a2c331-b1e7-4ac4-92d7-698ce117d3f7', 'be1c2e5e-3b60-46f7-8595-8ced5456575d', 'e4732f0e-177c-48ab-bd40-870e24aa84fd', 'ddb277bf-591c-4ae0-8f91-1bac65056c5d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:40:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:40:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:40:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:40:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:40:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:40:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.131s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:02 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:40:02 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Deleted volume successfully.
Sep 10 19:40:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-29bdb8b3-1e3b-4bfb-ada1-af2a9995f29c tempest-VolumesTransfersV357Test-198163122 None] Lock "cinder-9e4fce46-1a99-4cd3-b9fb-80cfbe570f88-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:40:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-d429ebdb-9e89-422c-8a1f-6a9dd983afae req-cb1fada9-63af-4679-a84c-14b8f10286f3 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:40:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-d429ebdb-9e89-422c-8a1f-6a9dd983afae req-cb1fada9-63af-4679-a84c-14b8f10286f3 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:40:03 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[846d34c3-f26c-4885-b2ee-99f398d802b0]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:40:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d429ebdb-9e89-422c-8a1f-6a9dd983afae req-cb1fada9-63af-4679-a84c-14b8f10286f3 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:04 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Flow 'volume_create_manager' (3c21f667-2f42-476e-aba0-d6c7db0377a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11d0783-d3be-450c-b21c-fe40e5ff0fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d429ebdb-9e89-422c-8a1f-6a9dd983afae req-cb1fada9-63af-4679-a84c-14b8f10286f3 tempest-TestServerVolumeAttachmentScenario-1398570564 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508" returned: 0 in 0.775s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-d429ebdb-9e89-422c-8a1f-6a9dd983afae req-cb1fada9-63af-4679-a84c-14b8f10286f3 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.808s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11d0783-d3be-450c-b21c-fe40e5ff0fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-950964207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbd6eed-e5a6-4d82-a9bb-5b38e6377824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62322d15d9804872893cf545017e7844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:40:04Z,use_quota=True,user_id='c5df3531e62b47de8a89c7032109376f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba7e129-874e-4fac-b7a8-c69de7be7f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba7e129-874e-4fac-b7a8-c69de7be7f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee803ac3-3c28-4f67-8585-d20ab2e17ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee803ac3-3c28-4f67-8585-d20ab2e17ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdbd6eed-e5a6-4d82-a9bb-5b38e6377824', 'volume_name': 'volume-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a0d9c5-c0f6-4c5a-afec-8059c6c86ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a0d9c5-c0f6-4c5a-afec-8059c6c86ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0ceb14-9136-45de-86e8-c43bc1739b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:04 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Volume bdbd6eed-e5a6-4d82-a9bb-5b38e6377824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824', 'volume_size': 1}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-950964207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbd6eed-e5a6-4d82-a9bb-5b38e6377824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62322d15d9804872893cf545017e7844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:40:04Z,use_quota=True,user_id='c5df3531e62b47de8a89c7032109376f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Creating volume bdbd6eed-e5a6-4d82-a9bb-5b38e6377824 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:40:04 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:04 devstack quobyte-client[82855]: System call of process 93029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:40:04 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=81, name=volume-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824 1073741824" returned: 0 in 0.483s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-d429ebdb-9e89-422c-8a1f-6a9dd983afae req-cb1fada9-63af-4679-a84c-14b8f10286f3 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38e21da5-987e-47db-b2f6-f4597ebcffde', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:40:05 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-d429ebdb-9e89-422c-8a1f-6a9dd983afae req-cb1fada9-63af-4679-a84c-14b8f10286f3 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:40:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824" returned: 0 in 0.390s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] <== create_volume: return (912ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:40:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:40:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0ceb14-9136-45de-86e8-c43bc1739b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bb969d-a51a-4107-a501-25d0736c8699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:05 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Volume volume-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824 (bdbd6eed-e5a6-4d82-a9bb-5b38e6377824): created successfully
Sep 10 19:40:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bb969d-a51a-4107-a501-25d0736c8699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Flow 'volume_create_manager' (3c21f667-2f42-476e-aba0-d6c7db0377a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:40:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-d429ebdb-9e89-422c-8a1f-6a9dd983afae req-cb1fada9-63af-4679-a84c-14b8f10286f3 tempest-TestServerVolumeAttachmentScenario-1398570564 None] attachment_update completed successfully.
Sep 10 19:40:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4fb28bd8-5e02-4e61-b232-0f1351e6701c tempest-VolumesTransfersV357Test-1137225958 None] Created volume successfully.
Sep 10 19:40:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Acquiring lock "cinder-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:40:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Lock "cinder-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:40:06 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:40:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Acquiring lock "cinder-quobyte-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:40:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Lock "cinder-quobyte-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824" acquired by "delete_volume" :: waited 0.047s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:40:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8fd1f2-9e5b-4743-ba69-0846b728a4e7]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:40:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824" returned: 0 in 0.581s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824" returned: 0 in 0.160s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Lock "cinder-quobyte-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824" released by "delete_volume" :: held 1.073s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:40:08 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Created reservations ['6bacf3e6-9635-4b66-b56d-76e73af93056', 'c66bbc01-242d-4d46-93be-f664a0d1b1f6', 'b475ca22-3693-4fe8-b886-b11981a02f51', '6b85f848-e910-4a1f-9ec4-74d33f480c9b'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:40:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:40:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:40:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:40:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:40:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:40:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.098s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:08 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:40:08 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Deleted volume successfully.
Sep 10 19:40:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b8dfa7de-a557-4db3-893b-40c3cfef0c24 tempest-VolumesTransfersV357Test-198163122 None] Lock "cinder-bdbd6eed-e5a6-4d82-a9bb-5b38e6377824-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:40:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:40:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:40:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:40:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:40:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:40:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:40:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.283s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:40:18 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=29,cinder:UPDATE=36,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:40:18 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=30,cinder:DELETE=5,cinder:SELECT=30,cinder:INSERT=9 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:40:19 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Flow 'volume_create_manager' (cbf0af3b-d109-4737-a68c-b68013534cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfab57e5-325d-4301-9bd3-08822b37f80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfab57e5-325d-4301-9bd3-08822b37f80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-30325824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a4001f-6eba-4198-90ea-7e2750f63632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='431041e885fe44b59f4baa04c75183da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:40:19Z,use_quota=True,user_id='c63ca835a2424d74a55dbf528bbb841d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c0f521-566d-4a7a-80b7-0c3ef1b5f757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c0f521-566d-4a7a-80b7-0c3ef1b5f757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2077003b-7c38-4926-97c6-404927698e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2077003b-7c38-4926-97c6-404927698e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a4001f-6eba-4198-90ea-7e2750f63632', 'volume_name': 'volume-f1a4001f-6eba-4198-90ea-7e2750f63632', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05bf02dc-ed46-4937-9e91-0b6fcf0bfc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05bf02dc-ed46-4937-9e91-0b6fcf0bfc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d874c42c-899c-4f7d-9778-997c0be10c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:19 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Volume f1a4001f-6eba-4198-90ea-7e2750f63632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a4001f-6eba-4198-90ea-7e2750f63632', 'volume_size': 1}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-30325824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a4001f-6eba-4198-90ea-7e2750f63632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='431041e885fe44b59f4baa04c75183da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:40:19Z,use_quota=True,user_id='c63ca835a2424d74a55dbf528bbb841d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Creating volume f1a4001f-6eba-4198-90ea-7e2750f63632 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:40:19 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:40:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f1a4001f-6eba-4198-90ea-7e2750f63632 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:19 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=82, name=volume-f1a4001f-6eba-4198-90ea-7e2750f63632, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:40:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f1a4001f-6eba-4198-90ea-7e2750f63632 1073741824" returned: 0 in 0.538s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f1a4001f-6eba-4198-90ea-7e2750f63632 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f1a4001f-6eba-4198-90ea-7e2750f63632" returned: 0 in 0.100s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] <== create_volume: return (721ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:40:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:40:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d874c42c-899c-4f7d-9778-997c0be10c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a4001f-6eba-4198-90ea-7e2750f63632', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e451e40-5f41-4658-b067-cf5fabbbf6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:20 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Volume volume-f1a4001f-6eba-4198-90ea-7e2750f63632 (f1a4001f-6eba-4198-90ea-7e2750f63632): created successfully
Sep 10 19:40:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e451e40-5f41-4658-b067-cf5fabbbf6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Flow 'volume_create_manager' (cbf0af3b-d109-4737-a68c-b68013534cb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:40:20 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d65d9fb3-72b2-4ba7-96e8-e82e6518434e tempest-VolumesNegativeTest-235825263 None] Created volume successfully.
Sep 10 19:40:24 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Flow 'volume_create_manager' (a3c31504-02e6-46ab-a630-24ca345a5da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e80652-2519-4ddd-9962-053268622add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e80652-2519-4ddd-9962-053268622add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1799106907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2248a5-df62-42db-9f2b-8b8cef17578e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3daaa8fbb6f74981988ac6e815c0d29f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:40:24Z,use_quota=True,user_id='8952dab0069a4e73a5aec1baf0ca59dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67d420d-b3f5-4664-99c9-723f59c71c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67d420d-b3f5-4664-99c9-723f59c71c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4212da-dd8e-4fac-afd0-299a27f0dd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4212da-dd8e-4fac-afd0-299a27f0dd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2248a5-df62-42db-9f2b-8b8cef17578e', 'volume_name': 'volume-0b2248a5-df62-42db-9f2b-8b8cef17578e', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f946657c-c166-4af7-ba7a-cd39de6b6ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f946657c-c166-4af7-ba7a-cd39de6b6ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc19cf7-3fd4-4164-b3dc-dfb633ebfe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:24 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Volume 0b2248a5-df62-42db-9f2b-8b8cef17578e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2248a5-df62-42db-9f2b-8b8cef17578e', 'volume_size': 1}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1799106907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2248a5-df62-42db-9f2b-8b8cef17578e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3daaa8fbb6f74981988ac6e815c0d29f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:40:24Z,use_quota=True,user_id='8952dab0069a4e73a5aec1baf0ca59dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Creating volume 0b2248a5-df62-42db-9f2b-8b8cef17578e {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:40:24 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:40:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0b2248a5-df62-42db-9f2b-8b8cef17578e 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:24 devstack quobyte-client[82855]: System call of process 93121 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:40:24 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=83, name=volume-0b2248a5-df62-42db-9f2b-8b8cef17578e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:40:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0b2248a5-df62-42db-9f2b-8b8cef17578e 1073741824" returned: 0 in 0.483s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0b2248a5-df62-42db-9f2b-8b8cef17578e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0b2248a5-df62-42db-9f2b-8b8cef17578e" returned: 0 in 0.133s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] <== create_volume: return (699ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:40:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:40:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc19cf7-3fd4-4164-b3dc-dfb633ebfe39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2248a5-df62-42db-9f2b-8b8cef17578e', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89740d8d-5779-4079-8f04-1a786067ede8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:25 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Volume volume-0b2248a5-df62-42db-9f2b-8b8cef17578e (0b2248a5-df62-42db-9f2b-8b8cef17578e): created successfully
Sep 10 19:40:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89740d8d-5779-4079-8f04-1a786067ede8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Flow 'volume_create_manager' (a3c31504-02e6-46ab-a630-24ca345a5da3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:40:25 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c211adac-65b9-4cbb-81ac-401a0e779270 tempest-AttachVolumeTestJSON-16455690 None] Created volume successfully.
Sep 10 19:40:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-1fd14f12-a81e-4a88-a4aa-4ab79259864f req-db28c8e0-0208-4301-b664-eda069f12c3f tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:40:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-1fd14f12-a81e-4a88-a4aa-4ab79259864f req-db28c8e0-0208-4301-b664-eda069f12c3f tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:40:31 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0238b98c-618b-4d04-a5f3-ff1f43cde9ad]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:40:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-1fd14f12-a81e-4a88-a4aa-4ab79259864f req-db28c8e0-0208-4301-b664-eda069f12c3f tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0b2248a5-df62-42db-9f2b-8b8cef17578e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:32 devstack quobyte-client[82855]: System call of process 93143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:40:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-1fd14f12-a81e-4a88-a4aa-4ab79259864f req-db28c8e0-0208-4301-b664-eda069f12c3f tempest-AttachVolumeTestJSON-16455690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0b2248a5-df62-42db-9f2b-8b8cef17578e" returned: 0 in 0.925s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-1fd14f12-a81e-4a88-a4aa-4ab79259864f req-db28c8e0-0208-4301-b664-eda069f12c3f tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.046s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:40:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-1fd14f12-a81e-4a88-a4aa-4ab79259864f req-db28c8e0-0208-4301-b664-eda069f12c3f tempest-AttachVolumeTestJSON-16455690 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-0b2248a5-df62-42db-9f2b-8b8cef17578e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cc13b79-3bed-4d4f-8618-58729efecbf2', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:40:32 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-1fd14f12-a81e-4a88-a4aa-4ab79259864f req-db28c8e0-0208-4301-b664-eda069f12c3f tempest-AttachVolumeTestJSON-16455690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:40:32 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-1fd14f12-a81e-4a88-a4aa-4ab79259864f req-db28c8e0-0208-4301-b664-eda069f12c3f tempest-AttachVolumeTestJSON-16455690 None] attachment_update completed successfully.
Sep 10 19:40:36 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-491f0a5e-8539-4455-8078-126659fefd70 req-70ffcfb7-5194-4011-9056-efb502484d59 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:40:36 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-491f0a5e-8539-4455-8078-126659fefd70 req-70ffcfb7-5194-4011-9056-efb502484d59 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:40:36 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-491f0a5e-8539-4455-8078-126659fefd70 req-70ffcfb7-5194-4011-9056-efb502484d59 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Terminate volume connection completed successfully.
Sep 10 19:40:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-491f0a5e-8539-4455-8078-126659fefd70 req-70ffcfb7-5194-4011-9056-efb502484d59 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Deleting attachment 38e21da5-987e-47db-b2f6-f4597ebcffde. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:40:46 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=5,cinder:SELECT=6,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:40:46 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=11,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:41:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-e8ea15e4-4ce5-4684-85e7-0be6af092288 req-6fa3263c-1324-4f5a-a869-efa1bbf89ec4 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-e8ea15e4-4ce5-4684-85e7-0be6af092288 req-6fa3263c-1324-4f5a-a869-efa1bbf89ec4 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:02 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-e8ea15e4-4ce5-4684-85e7-0be6af092288 req-6fa3263c-1324-4f5a-a869-efa1bbf89ec4 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Terminate volume connection completed successfully.
Sep 10 19:41:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-e8ea15e4-4ce5-4684-85e7-0be6af092288 req-6fa3263c-1324-4f5a-a869-efa1bbf89ec4 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Deleting attachment 56561bf1-8be2-4b32-8d68-668d821ebc86. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:41:12 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:41:12 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:41:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:41:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:41:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:41:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.345s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:41:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Acquiring lock "cinder-f1a4001f-6eba-4198-90ea-7e2750f63632-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Lock "cinder-f1a4001f-6eba-4198-90ea-7e2750f63632-delete_volume" acquired by "delete_volume" :: waited 0.148s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:16 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Acquiring lock "cinder-quobyte-f1a4001f-6eba-4198-90ea-7e2750f63632" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Lock "cinder-quobyte-f1a4001f-6eba-4198-90ea-7e2750f63632" acquired by "delete_volume" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:16 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d827e7-5a72-4e75-b1e4-733ca42533e7]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:41:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f1a4001f-6eba-4198-90ea-7e2750f63632 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f1a4001f-6eba-4198-90ea-7e2750f63632" returned: 0 in 1.111s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f1a4001f-6eba-4198-90ea-7e2750f63632 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f1a4001f-6eba-4198-90ea-7e2750f63632" returned: 0 in 0.189s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Lock "cinder-quobyte-f1a4001f-6eba-4198-90ea-7e2750f63632" released by "delete_volume" :: held 1.528s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:18 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Created reservations ['9c27c46a-8eac-48bd-b7e5-4f6c5ec8d90d', '2e49160b-e217-46fb-9958-0afceb1564a6', 'c24575ec-a9e7-49c6-9bff-757bc423e832', 'a2b4f3e2-f1c2-4895-ba83-7b74e0d68ccd'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:41:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:41:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:41:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.113s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:18 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:41:18 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Deleted volume successfully.
Sep 10 19:41:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ecd12eab-d5ca-4b03-9d67-3dbf40888ff5 tempest-VolumesNegativeTest-235825263 None] Lock "cinder-f1a4001f-6eba-4198-90ea-7e2750f63632-delete_volume" released by "delete_volume" :: held 3.103s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Acquiring lock "cinder-d512c084-bcb5-4403-9dd1-da4a9b1ba508-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "cinder-d512c084-bcb5-4403-9dd1-da4a9b1ba508-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:22 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Acquiring lock "cinder-quobyte-d512c084-bcb5-4403-9dd1-da4a9b1ba508" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "cinder-quobyte-d512c084-bcb5-4403-9dd1-da4a9b1ba508" acquired by "delete_volume" :: waited 0.053s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:22 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf676e4d-98c5-48af-b0d0-bcc82eb152b3]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:41:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508" returned: 0 in 0.889s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d512c084-bcb5-4403-9dd1-da4a9b1ba508" returned: 0 in 0.460s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "cinder-quobyte-d512c084-bcb5-4403-9dd1-da4a9b1ba508" released by "delete_volume" :: held 1.604s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:25 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Created reservations ['5757dd90-9635-4db5-931b-506456298b3b', '8313b7b7-8981-49e2-a01e-9b3380cf011b', '651729a7-fd54-4807-8386-26eb21664b09', '444d308b-1d37-4ca2-bdf8-1744ad53f4ee'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:41:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:41:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:41:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.402s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:25 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:41:25 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Deleted volume successfully.
Sep 10 19:41:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d042865b-c401-4e7a-9344-3034a1397f6e tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "cinder-d512c084-bcb5-4403-9dd1-da4a9b1ba508-delete_volume" released by "delete_volume" :: held 3.774s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Acquiring lock "cinder-a55bbf3c-cd91-4665-b574-ab814a442d48-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "cinder-a55bbf3c-cd91-4665-b574-ab814a442d48-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:26 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Acquiring lock "cinder-quobyte-a55bbf3c-cd91-4665-b574-ab814a442d48" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "cinder-quobyte-a55bbf3c-cd91-4665-b574-ab814a442d48" acquired by "delete_volume" :: waited 0.036s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:27 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79c8300-0dca-4236-bc71-0e764c4bfbb2]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:41:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a55bbf3c-cd91-4665-b574-ab814a442d48 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:27 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:27 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Flow 'volume_create_manager' (d33d943d-55bc-479f-93df-d62e5844d91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b873f7-ddf1-4434-a612-eb41b6bb8ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b873f7-ddf1-4434-a612-eb41b6bb8ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1812159219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6115a30-e88f-4eb5-88ac-30e318ebcee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea46d9b80ce4879847200240fe318c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:41:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:41:27Z,use_quota=True,user_id='c853a75247474d839caa1090b015ffed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe438e46-44bc-4b79-8d4d-a92d33f9208b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe438e46-44bc-4b79-8d4d-a92d33f9208b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e11c1f-3152-4d31-ab7a-675050798bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e11c1f-3152-4d31-ab7a-675050798bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6115a30-e88f-4eb5-88ac-30e318ebcee5', 'volume_name': 'volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5', 'volume_size': 2}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af25ed0-b361-48ef-addb-330beb492d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af25ed0-b361-48ef-addb-330beb492d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62856996-61b3-4bab-aa1d-7a740f7d4a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:28 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Volume f6115a30-e88f-4eb5-88ac-30e318ebcee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5', 'volume_size': 2}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1812159219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6115a30-e88f-4eb5-88ac-30e318ebcee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea46d9b80ce4879847200240fe318c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:41:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:41:27Z,use_quota=True,user_id='c853a75247474d839caa1090b015ffed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Creating volume f6115a30-e88f-4eb5-88ac-30e318ebcee5 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:41:28 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5 2147483648 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a55bbf3c-cd91-4665-b574-ab814a442d48" returned: 0 in 1.360s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a55bbf3c-cd91-4665-b574-ab814a442d48 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:28 devstack quobyte-client[82855]: System call of process 93961 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:41:28 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=84, name=volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a55bbf3c-cd91-4665-b574-ab814a442d48" returned: 0 in 0.177s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "cinder-quobyte-a55bbf3c-cd91-4665-b574-ab814a442d48" released by "delete_volume" :: held 1.819s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5 2147483648" returned: 0 in 0.720s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5" returned: 0 in 0.268s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] <== create_volume: return (1073ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62856996-61b3-4bab-aa1d-7a740f7d4a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5', 'volume_size': 2}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19673de2-01a3-4628-a916-be146ff44760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:29 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Volume volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5 (f6115a30-e88f-4eb5-88ac-30e318ebcee5): created successfully
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19673de2-01a3-4628-a916-be146ff44760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Flow 'volume_create_manager' (d33d943d-55bc-479f-93df-d62e5844d91d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Created reservations ['d9cfc4f2-82c7-45da-9af3-7fd4ba95d483', 'd2dc4e85-d421-44a3-be80-643eb76356f5', '45c112cb-29cf-4466-ac47-0f7cb2f7b6c3', 'af7fa654-219d-4f8d-b21f-4cff9847f55d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:41:29 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-45397f15-74b8-41f9-ae3f-c3b660758f78 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Created volume successfully.
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.089s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:29 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:41:30 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Deleted volume successfully.
Sep 10 19:41:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8a073eb4-4864-44df-a310-c6fbadeba938 tempest-TestServerVolumeAttachmentScenario-1398570564 None] Lock "cinder-a55bbf3c-cd91-4665-b574-ab814a442d48-delete_volume" released by "delete_volume" :: held 3.836s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:31 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Creating offline snapshot 4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a of volume f6115a30-e88f-4eb5-88ac-30e318ebcee5 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:41:31 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb3e0c2-e4e6-42cd-b327-6f6c5d346182]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:41:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5" returned: 0 in 0.581s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a 2G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:32 devstack quobyte-client[82855]: System call of process 93970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:41:32 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=85, name=volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:41:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a 2G" returned: 0 in 0.322s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "qemu-img rebase -u -b volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a" returned: 0 in 0.213s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:41:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a" returned: 0 in 0.160s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:41:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a" returned: 0 in 0.129s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.info" returned: 0 in 0.248s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:41:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.info" returned: 0 in 0.182s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.447s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5d1e354f-7088-441e-863c-b4b9fe52e159 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Create snapshot completed successfully
Sep 10 19:41:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Acquiring lock "cinder-4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "cinder-4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:34 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Acquiring lock "cinder-quobyte-f6115a30-e88f-4eb5-88ac-30e318ebcee5" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "cinder-quobyte-f6115a30-e88f-4eb5-88ac-30e318ebcee5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Acquiring lock "cinder-quobyte-4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "cinder-quobyte-4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Deleting offline snapshot 4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a of volume f6115a30-e88f-4eb5-88ac-30e318ebcee5 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:41:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] snapshot_file for this snap is: volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:41:34 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9620f3d9-a667-40ca-abdb-7000ce11bdc7]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:41:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a" returned: 0 in 0.477s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:41:35 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd06ab90-524a-4e4b-ad70-443225476a01]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:41:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5" returned: 0 in 0.633s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:36 devstack quobyte-client[82855]: System call of process 93988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:41:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a" returned: 0 in 0.449s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5.4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a" returned: 0 in 0.186s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "cinder-quobyte-4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a" released by "_delete_snapshot" :: held 2.253s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "cinder-quobyte-f6115a30-e88f-4eb5-88ac-30e318ebcee5" released by "delete_snapshot" :: held 2.299s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:37 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Created reservations ['b59aa600-5ac0-40a0-a825-39c2c462e749', 'acddd223-98b1-467b-a9b1-57cb7a9cf201', '2c96062d-0fa8-453f-ab9a-77bb3cdf49da', 'eb79686c-b186-4821-848b-06e9b6a22914'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:41:37 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Delete snapshot completed successfully.
Sep 10 19:41:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e298b572-5be7-45b5-a44a-b17bc3f64677 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "cinder-4307cd6e-bd7e-4c9c-9c9c-fdcc4b12042a-delete_snapshot" released by "delete_snapshot" :: held 3.013s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Acquiring lock "cinder-f6115a30-e88f-4eb5-88ac-30e318ebcee5-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "cinder-f6115a30-e88f-4eb5-88ac-30e318ebcee5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:38 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Acquiring lock "cinder-quobyte-f6115a30-e88f-4eb5-88ac-30e318ebcee5" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "cinder-quobyte-f6115a30-e88f-4eb5-88ac-30e318ebcee5" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:38 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2554d43c-d652-4f44-bbd0-7c9063dc77bc]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:41:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:39 devstack quobyte-client[82855]: System call of process 93993 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:41:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5" returned: 0 in 0.957s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f6115a30-e88f-4eb5-88ac-30e318ebcee5" returned: 0 in 0.152s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "cinder-quobyte-f6115a30-e88f-4eb5-88ac-30e318ebcee5" released by "delete_volume" :: held 1.316s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:40 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Created reservations ['d3679cc1-4ca4-45c0-b9e8-c3d6c4ad31c8', '7606b01f-e137-468f-928e-7dc34124a3d0', '3c266896-272d-492a-8924-bac573127441', '57c3b308-35d6-45fc-bd66-923307b2d9aa'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:41:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:41:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:41:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.130s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:40 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:41:40 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Deleted volume successfully.
Sep 10 19:41:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b89c59ac-c92f-4d8e-a210-8a47917480a0 tempest-VolumesSnapshotNegativeTestJSON-103721064 None] Lock "cinder-f6115a30-e88f-4eb5-88ac-30e318ebcee5-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:47 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Flow 'volume_create_manager' (31280065-44bb-4b06-b31a-0fd46da61e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3410bf33-d954-4048-b80e-60fe3eee2147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3410bf33-d954-4048-b80e-60fe3eee2147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-29967143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a92ef76-6c7a-472c-8c60-e91fc2ba553c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5392cf8b10b14a459777dc0484fe1ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:41:47Z,use_quota=True,user_id='20ee8449497c47709c74115b386a2fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8d9498-b3d8-4777-9131-0780fbc53285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8d9498-b3d8-4777-9131-0780fbc53285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a27ff9a-ea1a-44ca-8563-6e60d59ccd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a27ff9a-ea1a-44ca-8563-6e60d59ccd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a92ef76-6c7a-472c-8c60-e91fc2ba553c', 'volume_name': 'volume-1a92ef76-6c7a-472c-8c60-e91fc2ba553c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19e5c0d-e430-46b4-a8a7-2891344b98ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19e5c0d-e430-46b4-a8a7-2891344b98ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913668a7-8dc9-4b77-b069-36fa3ff7d882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:47 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Volume 1a92ef76-6c7a-472c-8c60-e91fc2ba553c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a92ef76-6c7a-472c-8c60-e91fc2ba553c', 'volume_size': 1}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-29967143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a92ef76-6c7a-472c-8c60-e91fc2ba553c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5392cf8b10b14a459777dc0484fe1ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:41:47Z,use_quota=True,user_id='20ee8449497c47709c74115b386a2fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Creating volume 1a92ef76-6c7a-472c-8c60-e91fc2ba553c {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:41:47 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:41:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1a92ef76-6c7a-472c-8c60-e91fc2ba553c 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:47 devstack quobyte-client[82855]: System call of process 94010 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:41:47 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=87, name=volume-1a92ef76-6c7a-472c-8c60-e91fc2ba553c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:41:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1a92ef76-6c7a-472c-8c60-e91fc2ba553c 1073741824" returned: 0 in 1.039s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1a92ef76-6c7a-472c-8c60-e91fc2ba553c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:49 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Flow 'volume_create_manager' (3d2b9e97-d505-4a26-a2a6-f407d8ce4c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddae1fc-b0fd-4b48-9dfa-f7ff58b491d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddae1fc-b0fd-4b48-9dfa-f7ff58b491d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1279682463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86f5fe2-eeeb-46c8-bc7d-59922afd325a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5392cf8b10b14a459777dc0484fe1ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:41:48Z,use_quota=True,user_id='20ee8449497c47709c74115b386a2fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7741924-91e6-4c4a-993a-a1d8414a56a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7741924-91e6-4c4a-993a-a1d8414a56a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1780b3cc-b3ae-4ed4-ac96-bc39d64b863b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1780b3cc-b3ae-4ed4-ac96-bc39d64b863b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b86f5fe2-eeeb-46c8-bc7d-59922afd325a', 'volume_name': 'volume-b86f5fe2-eeeb-46c8-bc7d-59922afd325a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03acda6-9329-43cb-a504-bbeb2098e05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03acda6-9329-43cb-a504-bbeb2098e05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04258946-7a64-46ce-96ea-036731a8c273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:49 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Volume b86f5fe2-eeeb-46c8-bc7d-59922afd325a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b86f5fe2-eeeb-46c8-bc7d-59922afd325a', 'volume_size': 1}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1a92ef76-6c7a-472c-8c60-e91fc2ba553c" returned: 0 in 1.211s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] <== create_volume: return (2367ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.392s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.094s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1279682463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86f5fe2-eeeb-46c8-bc7d-59922afd325a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5392cf8b10b14a459777dc0484fe1ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:41:48Z,use_quota=True,user_id='20ee8449497c47709c74115b386a2fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Creating volume b86f5fe2-eeeb-46c8-bc7d-59922afd325a {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:41:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:41:50 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b86f5fe2-eeeb-46c8-bc7d-59922afd325a 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:50 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:50 devstack quobyte-client[82855]: System call of process 94016 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:41:50 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=88, name=volume-b86f5fe2-eeeb-46c8-bc7d-59922afd325a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Flow 'volume_create_manager' (c992cd1e-c8d5-4c67-83b6-8c0fdd8cf2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35821442-2d6f-4928-a52a-79a30464fba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:50 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Flow 'volume_create_manager' (cd9eff31-2c7d-436a-8418-146ca4a53103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918d5888-09eb-4127-a9c3-51891b9a7336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35821442-2d6f-4928-a52a-79a30464fba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-234910847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8db7a21-ea9d-4497-8160-b3913d5c8538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5392cf8b10b14a459777dc0484fe1ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:41:50Z,use_quota=True,user_id='20ee8449497c47709c74115b386a2fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad14b2f0-4db5-4e22-9d5a-8076913b5369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad14b2f0-4db5-4e22-9d5a-8076913b5369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f207e06-246e-47e1-80c3-c0bd9307d690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f207e06-246e-47e1-80c3-c0bd9307d690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8db7a21-ea9d-4497-8160-b3913d5c8538', 'volume_name': 'volume-e8db7a21-ea9d-4497-8160-b3913d5c8538', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03e0010-9fe4-4c4c-8675-9a2a1f12e064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03e0010-9fe4-4c4c-8675-9a2a1f12e064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e91ba0-ec06-4710-901a-9d615fb53f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:50 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Volume e8db7a21-ea9d-4497-8160-b3913d5c8538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8db7a21-ea9d-4497-8160-b3913d5c8538', 'volume_size': 1}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918d5888-09eb-4127-a9c3-51891b9a7336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-471604562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd55551-b3be-46e4-b348-df5d2b747c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5392cf8b10b14a459777dc0484fe1ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:41:49Z,use_quota=True,user_id='20ee8449497c47709c74115b386a2fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4d4c52-58dc-4407-8d28-76285c26e5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4d4c52-58dc-4407-8d28-76285c26e5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b6fe0e-f747-4c13-ae28-22d380227c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b6fe0e-f747-4c13-ae28-22d380227c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd55551-b3be-46e4-b348-df5d2b747c11', 'volume_name': 'volume-6dd55551-b3be-46e4-b348-df5d2b747c11', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebe98c9-49f9-44ed-8013-1e2583684b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebe98c9-49f9-44ed-8013-1e2583684b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7089582f-7d9d-4152-abc2-bb79a32daf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:50 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Volume 6dd55551-b3be-46e4-b348-df5d2b747c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd55551-b3be-46e4-b348-df5d2b747c11', 'volume_size': 1}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b86f5fe2-eeeb-46c8-bc7d-59922afd325a 1073741824" returned: 0 in 0.905s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b86f5fe2-eeeb-46c8-bc7d-59922afd325a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913668a7-8dc9-4b77-b069-36fa3ff7d882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a92ef76-6c7a-472c-8c60-e91fc2ba553c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf27caa-713f-4730-8e42-a7047a764e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:51 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Flow 'volume_create_manager' (e9cc7d73-cebb-41b6-9aa4-002372347fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e879ec-4197-4730-be72-2d47e6fa90fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e879ec-4197-4730-be72-2d47e6fa90fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1431641858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc82163f-9c5b-46de-86e8-04d37ef84494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5392cf8b10b14a459777dc0484fe1ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:41:51Z,use_quota=True,user_id='20ee8449497c47709c74115b386a2fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac99727c-75cb-4b41-bcec-97aacfbd5af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac99727c-75cb-4b41-bcec-97aacfbd5af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1128be4e-9b21-4f77-b8b3-a200398a7a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1128be4e-9b21-4f77-b8b3-a200398a7a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc82163f-9c5b-46de-86e8-04d37ef84494', 'volume_name': 'volume-fc82163f-9c5b-46de-86e8-04d37ef84494', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a98391-6eb8-47a1-9015-2968234a3400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a98391-6eb8-47a1-9015-2968234a3400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952234a0-db2a-4f41-9739-963156ebb7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:51 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Volume fc82163f-9c5b-46de-86e8-04d37ef84494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc82163f-9c5b-46de-86e8-04d37ef84494', 'volume_size': 1}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b86f5fe2-eeeb-46c8-bc7d-59922afd325a" returned: 0 in 0.543s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:51 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Volume volume-1a92ef76-6c7a-472c-8c60-e91fc2ba553c (1a92ef76-6c7a-472c-8c60-e91fc2ba553c): created successfully
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf27caa-713f-4730-8e42-a7047a764e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Flow 'volume_create_manager' (31280065-44bb-4b06-b31a-0fd46da61e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] <== create_volume: return (1501ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.680s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-234910847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8db7a21-ea9d-4497-8160-b3913d5c8538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5392cf8b10b14a459777dc0484fe1ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:41:50Z,use_quota=True,user_id='20ee8449497c47709c74115b386a2fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Creating volume e8db7a21-ea9d-4497-8160-b3913d5c8538 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:41:51 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e8db7a21-ea9d-4497-8160-b3913d5c8538 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:51 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=89, name=volume-e8db7a21-ea9d-4497-8160-b3913d5c8538, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04258946-7a64-46ce-96ea-036731a8c273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b86f5fe2-eeeb-46c8-bc7d-59922afd325a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453ac6a6-b6e4-4464-b541-2ec106f07727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:51 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ee01680d-ba4f-4cd8-b1e8-4662fd5f3dd5 tempest-CreateVolumesFromImageTest-774845580 None] Created volume successfully.
Sep 10 19:41:51 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Volume volume-b86f5fe2-eeeb-46c8-bc7d-59922afd325a (b86f5fe2-eeeb-46c8-bc7d-59922afd325a): created successfully
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453ac6a6-b6e4-4464-b541-2ec106f07727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Flow 'volume_create_manager' (3d2b9e97-d505-4a26-a2a6-f407d8ce4c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:41:52 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b4ee5fe0-462e-43c6-9688-c32edc72f575 tempest-CreateVolumesFromImageTest-774845580 None] Created volume successfully.
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e8db7a21-ea9d-4497-8160-b3913d5c8538 1073741824" returned: 0 in 0.561s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e8db7a21-ea9d-4497-8160-b3913d5c8538 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e8db7a21-ea9d-4497-8160-b3913d5c8538" returned: 0 in 0.188s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] <== create_volume: return (789ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.479s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-471604562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd55551-b3be-46e4-b348-df5d2b747c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5392cf8b10b14a459777dc0484fe1ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:41:49Z,use_quota=True,user_id='20ee8449497c47709c74115b386a2fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Creating volume 6dd55551-b3be-46e4-b348-df5d2b747c11 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:41:52 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6dd55551-b3be-46e4-b348-df5d2b747c11 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:52 devstack quobyte-client[82855]: System call of process 94026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:41:52 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=90, name=volume-6dd55551-b3be-46e4-b348-df5d2b747c11, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e91ba0-ec06-4710-901a-9d615fb53f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8db7a21-ea9d-4497-8160-b3913d5c8538', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c59e49a-6c11-42d5-b723-a26f8ed2cb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:52 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Volume volume-e8db7a21-ea9d-4497-8160-b3913d5c8538 (e8db7a21-ea9d-4497-8160-b3913d5c8538): created successfully
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c59e49a-6c11-42d5-b723-a26f8ed2cb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Flow 'volume_create_manager' (c992cd1e-c8d5-4c67-83b6-8c0fdd8cf2b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6dd55551-b3be-46e4-b348-df5d2b747c11 1073741824" returned: 0 in 0.489s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6dd55551-b3be-46e4-b348-df5d2b747c11 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:53 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-338353be-170a-401c-90d4-54a57dbd926f tempest-CreateVolumesFromImageTest-774845580 None] Created volume successfully.
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6dd55551-b3be-46e4-b348-df5d2b747c11" returned: 0 in 0.298s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] <== create_volume: return (813ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.790s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1431641858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc82163f-9c5b-46de-86e8-04d37ef84494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5392cf8b10b14a459777dc0484fe1ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:41:51Z,use_quota=True,user_id='20ee8449497c47709c74115b386a2fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Creating volume fc82163f-9c5b-46de-86e8-04d37ef84494 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:41:53 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fc82163f-9c5b-46de-86e8-04d37ef84494 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:53 devstack quobyte-client[82855]: System call of process 94030 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:41:53 devstack quobyte-client[82855]: System call of process 94030 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:41:53 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=91, name=volume-fc82163f-9c5b-46de-86e8-04d37ef84494, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7089582f-7d9d-4152-abc2-bb79a32daf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd55551-b3be-46e4-b348-df5d2b747c11', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459cebb2-3112-4901-a9cd-383dd90e6bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fc82163f-9c5b-46de-86e8-04d37ef84494 1073741824" returned: 0 in 0.423s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fc82163f-9c5b-46de-86e8-04d37ef84494 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:53 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Volume volume-6dd55551-b3be-46e4-b348-df5d2b747c11 (6dd55551-b3be-46e4-b348-df5d2b747c11): created successfully
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459cebb2-3112-4901-a9cd-383dd90e6bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Flow 'volume_create_manager' (cd9eff31-2c7d-436a-8418-146ca4a53103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:41:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fc82163f-9c5b-46de-86e8-04d37ef84494" returned: 0 in 0.346s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] <== create_volume: return (794ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:41:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-211e6ae1-2247-4ca0-8bd1-4785dfbf1830 tempest-CreateVolumesFromImageTest-774845580 None] Created volume successfully.
Sep 10 19:41:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952234a0-db2a-4f41-9739-963156ebb7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc82163f-9c5b-46de-86e8-04d37ef84494', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc0ada4-0d53-4ecf-b25e-24ff889dbb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:41:54 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Volume volume-fc82163f-9c5b-46de-86e8-04d37ef84494 (fc82163f-9c5b-46de-86e8-04d37ef84494): created successfully
Sep 10 19:41:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc0ada4-0d53-4ecf-b25e-24ff889dbb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:41:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Flow 'volume_create_manager' (e9cc7d73-cebb-41b6-9aa4-002372347fc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:41:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-68a3251a-bc9c-4e4f-bf60-40d208cc8073 tempest-CreateVolumesFromImageTest-774845580 None] Created volume successfully.
Sep 10 19:41:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "cinder-fc82163f-9c5b-46de-86e8-04d37ef84494-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-fc82163f-9c5b-46de-86e8-04d37ef84494-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:54 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "cinder-quobyte-fc82163f-9c5b-46de-86e8-04d37ef84494" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-quobyte-fc82163f-9c5b-46de-86e8-04d37ef84494" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:54 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3694d0d5-044e-48a3-9c73-6a5351965f62]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:41:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fc82163f-9c5b-46de-86e8-04d37ef84494 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fc82163f-9c5b-46de-86e8-04d37ef84494" returned: 0 in 0.503s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fc82163f-9c5b-46de-86e8-04d37ef84494 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fc82163f-9c5b-46de-86e8-04d37ef84494" returned: 0 in 0.097s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-quobyte-fc82163f-9c5b-46de-86e8-04d37ef84494" released by "delete_volume" :: held 0.785s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:55 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Created reservations ['ee4e970e-2211-472c-8507-32d7b34fd6bd', '7d492397-c86e-449d-880b-e94e82c8a9cb', '6a53c184-e0fb-44ba-a398-4c3dcc2d0bd7', '714173bf-d63e-4af6-a66f-508165605191'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:41:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:41:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:41:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.135s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:56 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:41:56 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Deleted volume successfully.
Sep 10 19:41:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-592d17dd-85b0-4a65-b81c-53263cfbb953 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-fc82163f-9c5b-46de-86e8-04d37ef84494-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "cinder-e8db7a21-ea9d-4497-8160-b3913d5c8538-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-e8db7a21-ea9d-4497-8160-b3913d5c8538-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:57 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "cinder-quobyte-e8db7a21-ea9d-4497-8160-b3913d5c8538" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-quobyte-e8db7a21-ea9d-4497-8160-b3913d5c8538" acquired by "delete_volume" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:57 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5673a616-a930-479f-9f60-6d131fae4bf1]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:41:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e8db7a21-ea9d-4497-8160-b3913d5c8538 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e8db7a21-ea9d-4497-8160-b3913d5c8538" returned: 0 in 0.652s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e8db7a21-ea9d-4497-8160-b3913d5c8538 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e8db7a21-ea9d-4497-8160-b3913d5c8538" returned: 0 in 0.186s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-quobyte-e8db7a21-ea9d-4497-8160-b3913d5c8538" released by "delete_volume" :: held 1.100s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:59 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Created reservations ['dab88d8e-1adc-4344-9987-0aabc25f35a2', 'ca9fe7c4-ab3e-4167-bb6a-c8d90a88b3c5', '62b0cf21-a6df-4127-a2e5-4552d26318b6', 'f6546231-8642-4323-ab10-274339a27b57'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:41:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:41:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:41:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.157s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:59 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:41:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Deleted volume successfully.
Sep 10 19:41:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "cinder-6dd55551-b3be-46e4-b348-df5d2b747c11-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-670c1628-069d-4c60-98ab-77f6f7261cd7 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-e8db7a21-ea9d-4497-8160-b3913d5c8538-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-6dd55551-b3be-46e4-b348-df5d2b747c11-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:00 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "cinder-quobyte-6dd55551-b3be-46e4-b348-df5d2b747c11" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-quobyte-6dd55551-b3be-46e4-b348-df5d2b747c11" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:00 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bfbf79-72bf-41e0-82df-024d11a3204b]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6dd55551-b3be-46e4-b348-df5d2b747c11 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6dd55551-b3be-46e4-b348-df5d2b747c11" returned: 0 in 0.746s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6dd55551-b3be-46e4-b348-df5d2b747c11 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-6dd55551-b3be-46e4-b348-df5d2b747c11" returned: 0 in 0.327s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-quobyte-6dd55551-b3be-46e4-b348-df5d2b747c11" released by "delete_volume" :: held 1.615s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:02 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Created reservations ['49914a3b-bf52-4f9f-aafc-cd5ebeb2bc79', '12baf77b-8599-496f-bf00-1f2544eaf2d5', '539dcdc2-d422-4038-9569-f464bb3331c8', 'ccb19983-2cd5-4178-b17c-79c5e6113f4c'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:42:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.255s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:03 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:42:03 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Deleted volume successfully.
Sep 10 19:42:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "cinder-b86f5fe2-eeeb-46c8-bc7d-59922afd325a-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ab6bd9f-6855-421a-932d-3e51ae7665e9 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-6dd55551-b3be-46e4-b348-df5d2b747c11-delete_volume" released by "delete_volume" :: held 4.224s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-b86f5fe2-eeeb-46c8-bc7d-59922afd325a-delete_volume" acquired by "delete_volume" :: waited 0.146s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:04 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "cinder-quobyte-b86f5fe2-eeeb-46c8-bc7d-59922afd325a" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-quobyte-b86f5fe2-eeeb-46c8-bc7d-59922afd325a" acquired by "delete_volume" :: waited 0.048s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:04 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c255a88-c87f-4a82-a8ff-35f85b6852a3]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b86f5fe2-eeeb-46c8-bc7d-59922afd325a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b86f5fe2-eeeb-46c8-bc7d-59922afd325a" returned: 0 in 1.001s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b86f5fe2-eeeb-46c8-bc7d-59922afd325a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b86f5fe2-eeeb-46c8-bc7d-59922afd325a" returned: 0 in 0.279s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-quobyte-b86f5fe2-eeeb-46c8-bc7d-59922afd325a" released by "delete_volume" :: held 1.788s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:07 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Created reservations ['a9d0324d-dcdd-4ddf-84d1-b7671d16467c', '8429ccfd-16f6-4b55-b193-113606b503cc', '1cd62a59-7049-45c4-bdd4-d8be7f48e838', '19f22e36-9a7c-4d8c-9154-bb2dd6d6c2f0'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:42:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.135s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:07 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:42:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Deleted volume successfully.
Sep 10 19:42:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "cinder-1a92ef76-6c7a-472c-8c60-e91fc2ba553c-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e13e9106-7d48-4e30-9430-15b57825d7ff tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-b86f5fe2-eeeb-46c8-bc7d-59922afd325a-delete_volume" released by "delete_volume" :: held 4.111s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-1a92ef76-6c7a-472c-8c60-e91fc2ba553c-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:08 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "cinder-quobyte-1a92ef76-6c7a-472c-8c60-e91fc2ba553c" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-quobyte-1a92ef76-6c7a-472c-8c60-e91fc2ba553c" acquired by "delete_volume" :: waited 0.027s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:08 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3954e1c7-c9ad-4131-b4ef-f4def3e3de44]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1a92ef76-6c7a-472c-8c60-e91fc2ba553c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:09 devstack quobyte-client[82855]: System call of process 94108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:42:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1a92ef76-6c7a-472c-8c60-e91fc2ba553c" returned: 0 in 0.781s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1a92ef76-6c7a-472c-8c60-e91fc2ba553c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1a92ef76-6c7a-472c-8c60-e91fc2ba553c" returned: 0 in 0.163s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-quobyte-1a92ef76-6c7a-472c-8c60-e91fc2ba553c" released by "delete_volume" :: held 1.284s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:10 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Created reservations ['c1f73423-9abc-4cf1-a715-4962bb11c9b8', '00cbfde1-9392-4367-a6ba-6d73fe3fc70f', 'b982ac0f-4375-4d00-b277-8f739079b8d6', '9ea6250c-ea06-414c-b7d2-55b91afa3bd9'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:42:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.281s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:11 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:42:11 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Deleted volume successfully.
Sep 10 19:42:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b043f60c-549e-4ccc-b2c4-a6b07be08131 tempest-CreateVolumesFromImageTest-774845580 None] Lock "cinder-1a92ef76-6c7a-472c-8c60-e91fc2ba553c-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:42:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.339s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=49,cinder:INSERT=20,cinder:UPDATE=97,cinder:DELETE=9 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=86,cinder:SELECT=67,cinder:INSERT=20,cinder:DELETE=7 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:42:19 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Flow 'volume_create_manager' (4d82964b-040a-493d-9949-6f24926414bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab5c79f-d21a-4022-83e9-1e4357a6f2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab5c79f-d21a-4022-83e9-1e4357a6f2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0171ed12-6cb5-4707-baae-c85bcd74b2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='120cf0cd78c74482af1a5154b2b74e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:42:19Z,use_quota=True,user_id='43140452acfb4721a79bea43cf73aa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4493a84-d3bd-476a-b7c4-601347cdf0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4493a84-d3bd-476a-b7c4-601347cdf0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305bf413-5377-4da7-af05-4252c8c64389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305bf413-5377-4da7-af05-4252c8c64389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0171ed12-6cb5-4707-baae-c85bcd74b2f9', 'volume_name': 'volume-0171ed12-6cb5-4707-baae-c85bcd74b2f9', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3949a449-c5e1-46bb-9c08-ed13635ce41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3949a449-c5e1-46bb-9c08-ed13635ce41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e829d6b6-f946-4544-ad7b-f77165814eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:19 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Volume 0171ed12-6cb5-4707-baae-c85bcd74b2f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0171ed12-6cb5-4707-baae-c85bcd74b2f9', 'volume_size': 1}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0171ed12-6cb5-4707-baae-c85bcd74b2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='120cf0cd78c74482af1a5154b2b74e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:42:19Z,use_quota=True,user_id='43140452acfb4721a79bea43cf73aa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Creating volume 0171ed12-6cb5-4707-baae-c85bcd74b2f9 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:42:19 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:42:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0171ed12-6cb5-4707-baae-c85bcd74b2f9 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:20 devstack quobyte-client[82855]: System call of process 94125 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:42:20 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=92, name=volume-0171ed12-6cb5-4707-baae-c85bcd74b2f9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:42:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0171ed12-6cb5-4707-baae-c85bcd74b2f9 1073741824" returned: 0 in 0.724s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0171ed12-6cb5-4707-baae-c85bcd74b2f9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0171ed12-6cb5-4707-baae-c85bcd74b2f9" returned: 0 in 0.139s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] <== create_volume: return (981ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:42:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e829d6b6-f946-4544-ad7b-f77165814eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0171ed12-6cb5-4707-baae-c85bcd74b2f9', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19203dee-e291-44c0-bcff-62c0a5d00419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:21 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Volume volume-0171ed12-6cb5-4707-baae-c85bcd74b2f9 (0171ed12-6cb5-4707-baae-c85bcd74b2f9): created successfully
Sep 10 19:42:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19203dee-e291-44c0-bcff-62c0a5d00419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Flow 'volume_create_manager' (4d82964b-040a-493d-9949-6f24926414bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:42:21 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-497afb4d-0157-4404-a865-116d3a922d06 tempest-CinderUnicodeTest-547267404 None] Created volume successfully.
Sep 10 19:42:22 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Flow 'volume_create_manager' (737b433a-d3f3-4a95-8f90-65ed383f3133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd7aa5f-5063-4d15-93a5-d652182190eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd7aa5f-5063-4d15-93a5-d652182190eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:42:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1910873321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711b399b-195b-46fd-a513-952cc11bd06a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='120cf0cd78c74482af1a5154b2b74e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:42:22Z,use_quota=True,user_id='43140452acfb4721a79bea43cf73aa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b787040-e3c2-4c1a-abfc-f4bd9dbc258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b787040-e3c2-4c1a-abfc-f4bd9dbc258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64debea6-8474-47e1-af4d-1f22a22aefbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64debea6-8474-47e1-af4d-1f22a22aefbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '711b399b-195b-46fd-a513-952cc11bd06a', 'volume_name': 'volume-711b399b-195b-46fd-a513-952cc11bd06a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f35164-4aff-42e6-867e-5f01d64ea3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f35164-4aff-42e6-867e-5f01d64ea3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188f8dd5-a581-438e-a4ca-647d56d9260e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:22 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Volume 711b399b-195b-46fd-a513-952cc11bd06a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-711b399b-195b-46fd-a513-952cc11bd06a', 'volume_size': 1}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:42:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1910873321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711b399b-195b-46fd-a513-952cc11bd06a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='120cf0cd78c74482af1a5154b2b74e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:42:22Z,use_quota=True,user_id='43140452acfb4721a79bea43cf73aa08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Creating volume 711b399b-195b-46fd-a513-952cc11bd06a {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:42:22 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:22 devstack quobyte-client[82855]: System call of process 94138 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:42:22 devstack quobyte-client[82855]: System call of process 94138 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:42:22 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=93, name=volume-711b399b-195b-46fd-a513-952cc11bd06a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a 1073741824" returned: 0 in 0.402s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a" returned: 0 in 0.137s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] <== create_volume: return (623ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:42:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.635s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188f8dd5-a581-438e-a4ca-647d56d9260e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711b399b-195b-46fd-a513-952cc11bd06a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d88ffc-e219-471f-a94b-bdfe8918eb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:23 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Volume volume-711b399b-195b-46fd-a513-952cc11bd06a (711b399b-195b-46fd-a513-952cc11bd06a): created successfully
Sep 10 19:42:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d88ffc-e219-471f-a94b-bdfe8918eb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Flow 'volume_create_manager' (737b433a-d3f3-4a95-8f90-65ed383f3133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:42:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-883650ed-c891-48dc-8938-f5d9a2a19dca tempest-CinderUnicodeTest-547267404 None] Created volume successfully.
Sep 10 19:42:24 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] Creating offline snapshot c9cd5fef-60be-49a0-a7e8-37670002e775 of volume 711b399b-195b-46fd-a513-952cc11bd06a {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:42:24 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b4fe13-f5df-43b7-bc0b-c4d27e1e7e37]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a" returned: 0 in 0.507s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:25 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=94, name=volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:42:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775 1G" returned: 0 in 0.339s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): qemu-img rebase -u -b volume-711b399b-195b-46fd-a513-952cc11bd06a -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] CMD "qemu-img rebase -u -b volume-711b399b-195b-46fd-a513-952cc11bd06a -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775" returned: 0 in 0.196s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:42:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775" returned: 0 in 0.097s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:42:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775" returned: 0 in 0.095s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.info" returned: 0 in 0.105s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:42:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.info" returned: 0 in 0.098s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.793s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:26 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1d3b49b5-aaa2-4ede-90ce-df84ace61325 tempest-CinderUnicodeTest-547267404 None] Create snapshot completed successfully
Sep 10 19:42:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Acquiring lock "cinder-c9cd5fef-60be-49a0-a7e8-37670002e775-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Lock "cinder-c9cd5fef-60be-49a0-a7e8-37670002e775-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:28 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Acquiring lock "cinder-quobyte-711b399b-195b-46fd-a513-952cc11bd06a" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Lock "cinder-quobyte-711b399b-195b-46fd-a513-952cc11bd06a" acquired by "delete_snapshot" :: waited 0.036s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Acquiring lock "cinder-quobyte-c9cd5fef-60be-49a0-a7e8-37670002e775" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Lock "cinder-quobyte-c9cd5fef-60be-49a0-a7e8-37670002e775" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Deleting offline snapshot c9cd5fef-60be-49a0-a7e8-37670002e775 of volume 711b399b-195b-46fd-a513-952cc11bd06a {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:42:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] snapshot_file for this snap is: volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:42:28 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[66693cfe-5490-4e2d-9a72-db2505bd8cc3]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775" returned: 0 in 0.498s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-711b399b-195b-46fd-a513-952cc11bd06a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:42:28 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[03306f83-10e4-483d-9e2a-16637fff12cc]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a" returned: 0 in 0.565s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775" returned: 0 in 0.327s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a.c9cd5fef-60be-49a0-a7e8-37670002e775" returned: 0 in 0.141s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Lock "cinder-quobyte-c9cd5fef-60be-49a0-a7e8-37670002e775" released by "_delete_snapshot" :: held 1.895s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Lock "cinder-quobyte-711b399b-195b-46fd-a513-952cc11bd06a" released by "delete_snapshot" :: held 1.934s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:30 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Created reservations ['e4880328-f757-4c09-b4b4-2550b83423d1', '07e504dd-d60f-405a-9201-50a4e79e7d98', 'acdd1c01-6a54-4292-95a1-fadac35b3189', '94dfb450-0991-4e65-a49a-3ab4425cab86'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:42:30 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Delete snapshot completed successfully.
Sep 10 19:42:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0ffd8637-0190-40d3-81d7-537d16e7909f tempest-CinderUnicodeTest-547267404 None] Lock "cinder-c9cd5fef-60be-49a0-a7e8-37670002e775-delete_snapshot" released by "delete_snapshot" :: held 2.497s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Acquiring lock "cinder-711b399b-195b-46fd-a513-952cc11bd06a-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Lock "cinder-711b399b-195b-46fd-a513-952cc11bd06a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:31 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Acquiring lock "cinder-quobyte-711b399b-195b-46fd-a513-952cc11bd06a" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Lock "cinder-quobyte-711b399b-195b-46fd-a513-952cc11bd06a" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:31 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6505a3bc-f1ad-4063-874e-b97caa681a1e]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a" returned: 0 in 0.531s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-711b399b-195b-46fd-a513-952cc11bd06a" returned: 0 in 0.207s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Lock "cinder-quobyte-711b399b-195b-46fd-a513-952cc11bd06a" released by "delete_volume" :: held 0.941s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:33 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Created reservations ['3f71f62a-4570-4481-855c-318c588475c4', '2fa06e26-f209-449c-8e51-aef1214684b1', 'dc0772a2-603f-4604-b3d7-41653e3733bd', '56a951a4-0eb3-4b89-9d55-1d50049a53f2'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:42:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.119s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:33 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:42:33 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Deleted volume successfully.
Sep 10 19:42:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8fb85dbc-d479-4cd2-b999-2d8fcbd35a47 tempest-CinderUnicodeTest-547267404 None] Lock "cinder-711b399b-195b-46fd-a513-952cc11bd06a-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Acquiring lock "cinder-0171ed12-6cb5-4707-baae-c85bcd74b2f9-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Lock "cinder-0171ed12-6cb5-4707-baae-c85bcd74b2f9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:34 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Acquiring lock "cinder-quobyte-0171ed12-6cb5-4707-baae-c85bcd74b2f9" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Lock "cinder-quobyte-0171ed12-6cb5-4707-baae-c85bcd74b2f9" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:34 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fe3af3-3783-4aea-81f4-8c6e11ae1f18]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0171ed12-6cb5-4707-baae-c85bcd74b2f9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:34 devstack quobyte-client[82855]: System call of process 94172 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:42:34 devstack quobyte-client[82855]: System call of process 94172 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:42:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0171ed12-6cb5-4707-baae-c85bcd74b2f9" returned: 0 in 0.513s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0171ed12-6cb5-4707-baae-c85bcd74b2f9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0171ed12-6cb5-4707-baae-c85bcd74b2f9" returned: 0 in 0.103s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Lock "cinder-quobyte-0171ed12-6cb5-4707-baae-c85bcd74b2f9" released by "delete_volume" :: held 0.785s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:35 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Created reservations ['df41470e-1175-4643-8cc8-2fd6ac1b08bb', '5f0db236-5d9b-4e3a-87cb-fdd246424fa5', '0122f4be-8f0f-4bdb-be94-f48cbc68f123', '461ffea7-2442-42a7-a55d-a0ea3f9c93cf'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:42:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.092s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:35 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:42:35 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Deleted volume successfully.
Sep 10 19:42:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e889ccd6-f6ac-4986-adab-7599139176bd tempest-CinderUnicodeTest-547267404 None] Lock "cinder-0171ed12-6cb5-4707-baae-c85bcd74b2f9-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:39 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:39 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:42:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Flow 'volume_create_manager' (d6857aca-dc87-4bb8-bf09-b622f46e134e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:42:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad7e6d2-1973-470c-b736-6e92a4694a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad7e6d2-1973-470c-b736-6e92a4694a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-890950845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f980558e-5da7-4a6e-90fb-08b2620068f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a7343048c040adacc9a135dcd22bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:42:39Z,use_quota=True,user_id='c70f8ba7e2c44dabba98b8664a67c353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0995cc33-0227-4957-b84c-12055cc55ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0995cc33-0227-4957-b84c-12055cc55ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967e8cff-53dd-4723-86b8-93dfa905e0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967e8cff-53dd-4723-86b8-93dfa905e0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f980558e-5da7-4a6e-90fb-08b2620068f0', 'volume_name': 'volume-f980558e-5da7-4a6e-90fb-08b2620068f0', 'volume_size': 1, 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '489167b5c946434eba8a26e1f48a2447', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'created_at': datetime.datetime(2025, 9, 10, 17, 8, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/391d42a7-95bd-4118-889d-f5820ea8d60f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc578e6c460>}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d434ef74-f83a-41c4-86c3-880c2a2af06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d434ef74-f83a-41c4-86c3-880c2a2af06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29bf262-9418-4f44-ab50-86f5e71f147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:40 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Volume f980558e-5da7-4a6e-90fb-08b2620068f0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f980558e-5da7-4a6e-90fb-08b2620068f0', 'volume_size': 1, 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '489167b5c946434eba8a26e1f48a2447', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'created_at': datetime.datetime(2025, 9, 10, 17, 8, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/391d42a7-95bd-4118-889d-f5820ea8d60f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc578e6c460>}
Sep 10 19:42:40 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Cloning f980558e-5da7-4a6e-90fb-08b2620068f0 from image 391d42a7-95bd-4118-889d-f5820ea8d60f  at location (None, None). {{(pid=82850) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 19:42:40 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_0wbs0im2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 19:42:40 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Image download 20.69 MB at 20.69 MB/s
Sep 10 19:42:40 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe31247-086c-420b-a30c-0c7311048deb]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_0wbs0im2devstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:41 devstack sudo[94178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_0wbs0im2devstack@QuobyteHD
Sep 10 19:42:41 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-c668593c-1ba1-4fb1-985f-fa0e4f525cbd req-93d4bbec-2ef1-4519-9958-d7628eb0f6a6 tempest-AttachVolumeTestJSON-16455690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:41 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:42:41 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-c668593c-1ba1-4fb1-985f-fa0e4f525cbd req-93d4bbec-2ef1-4519-9958-d7628eb0f6a6 tempest-AttachVolumeTestJSON-16455690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:41 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-c668593c-1ba1-4fb1-985f-fa0e4f525cbd req-93d4bbec-2ef1-4519-9958-d7628eb0f6a6 tempest-AttachVolumeTestJSON-16455690 None] Terminate volume connection completed successfully.
Sep 10 19:42:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-c668593c-1ba1-4fb1-985f-fa0e4f525cbd req-93d4bbec-2ef1-4519-9958-d7628eb0f6a6 tempest-AttachVolumeTestJSON-16455690 None] Deleting attachment 2cc13b79-3bed-4d4f-8618-58729efecbf2. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:42:42 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root
Sep 10 19:42:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_0wbs0im2devstack@QuobyteHD" returned: 0 in 2.456s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:43 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Temporary image 391d42a7-95bd-4118-889d-f5820ea8d60f is fetched for user c70f8ba7e2c44dabba98b8664a67c353. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 19:42:43 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d688275-dcb8-4c38-be25-aa09b7544b0c]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_0wbs0im2devstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:43 devstack sudo[94185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_0wbs0im2devstack@QuobyteHD
Sep 10 19:42:43 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:42:46 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_0wbs0im2devstack@QuobyteHD" returned: 0 in 2.920s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-890950845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f980558e-5da7-4a6e-90fb-08b2620068f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a7343048c040adacc9a135dcd22bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:42:39Z,use_quota=True,user_id='c70f8ba7e2c44dabba98b8664a67c353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Creating volume f980558e-5da7-4a6e-90fb-08b2620068f0 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:42:46 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:46 devstack quobyte-client[82855]: System call of process 94227 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:42:46 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=96, name=volume-f980558e-5da7-4a6e-90fb-08b2620068f0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 1073741824" returned: 0 in 0.476s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0" returned: 0 in 0.081s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] <== create_volume: return (676ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:42:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:47 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Attempting download of 391d42a7-95bd-4118-889d-f5820ea8d60f ((None, None)) to volume f980558e-5da7-4a6e-90fb-08b2620068f0. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 19:42:47 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b793b4-bd77-4ca3-a067-47d8e8776f7b]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_753z9r8n {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_753z9r8n" returned: 0 in 0.381s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_753z9r8n {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_753z9r8n" returned: 1 in 0.424s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_391d42a7-95bd-4118-889d-f5820ea8d60f_753z9r8n' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:42:48 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc31d14-035b-4c12-9007-623dafe5aef1]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_0wbs0im2devstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_0wbs0im2devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:48 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] 391d42a7-95bd-4118-889d-f5820ea8d60f was qcow2, converting to raw {{(pid=82850) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 19:42:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_0wbs0im2devstack@QuobyteHD /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:48 devstack quobyte-client[82855]: System call of process 94241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:42:48 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=96, name=volume-f980558e-5da7-4a6e-90fb-08b2620068f0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:42:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_0wbs0im2devstack@QuobyteHD /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0" returned: 0 in 1.200s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:49 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_391d42a7-95bd-4118-889d-f5820ea8d60f_0wbs0im2devstack@QuobyteHD, size 112.00 MB, duration 1.23 sec, destination /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:42:49 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Converted 112.00 MB image at 91.27 MB/s
Sep 10 19:42:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 1G" returned: 0 in 0.128s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:50 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcde8d76-5780-4b67-9469-1231731a9095]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0" returned: 0 in 0.400s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0" returned: 1 in 0.443s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:42:51 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Downloaded image 391d42a7-95bd-4118-889d-f5820ea8d60f ((None, None)) to volume f980558e-5da7-4a6e-90fb-08b2620068f0 successfully. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 19:42:51 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Temporary image 391d42a7-95bd-4118-889d-f5820ea8d60f for user c70f8ba7e2c44dabba98b8664a67c353 is deleted. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 19:42:51 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Marking volume f980558e-5da7-4a6e-90fb-08b2620068f0 as bootable. {{(pid=82850) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 19:42:51 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Copying metadata from image 391d42a7-95bd-4118-889d-f5820ea8d60f to f980558e-5da7-4a6e-90fb-08b2620068f0. {{(pid=82850) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 19:42:51 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Creating volume glance metadata for volume f980558e-5da7-4a6e-90fb-08b2620068f0 backed by image 391d42a7-95bd-4118-889d-f5820ea8d60f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82850) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 19:42:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29bf262-9418-4f44-ab50-86f5e71f147d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f980558e-5da7-4a6e-90fb-08b2620068f0', 'volume_size': 1, 'image_id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '489167b5c946434eba8a26e1f48a2447', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '391d42a7-95bd-4118-889d-f5820ea8d60f', 'created_at': datetime.datetime(2025, 9, 10, 17, 8, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/391d42a7-95bd-4118-889d-f5820ea8d60f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc578e6c460>}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2ab979-a395-4425-987d-422314c01e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:51 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Volume volume-f980558e-5da7-4a6e-90fb-08b2620068f0 (f980558e-5da7-4a6e-90fb-08b2620068f0): created successfully
Sep 10 19:42:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2ab979-a395-4425-987d-422314c01e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Flow 'volume_create_manager' (d6857aca-dc87-4bb8-bf09-b622f46e134e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:42:51 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fcb00254-a4a9-4485-8b70-a04b9ff7121a tempest-TestShelveInstance-494855624 None] Created volume successfully.
Sep 10 19:43:01 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=30,cinder:DELETE=2,cinder:SELECT=32,cinder:INSERT=21 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:43:01 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=22,cinder:UPDATE=29,cinder:DELETE=4,cinder:INSERT=4 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:43:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-435fbacf-f3fe-4ba0-93b2-f56910ff4a61 req-12efcc29-499b-4710-b423-1a07163ea41f tempest-TestShelveInstance-494855624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:43:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-435fbacf-f3fe-4ba0-93b2-f56910ff4a61 req-12efcc29-499b-4710-b423-1a07163ea41f tempest-TestShelveInstance-494855624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.020s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:43:04 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb937c6-27db-43ff-930e-412a0e1741e5]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:43:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-435fbacf-f3fe-4ba0-93b2-f56910ff4a61 req-12efcc29-499b-4710-b423-1a07163ea41f tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:05 devstack quobyte-client[82855]: System call of process 94377 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:43:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-435fbacf-f3fe-4ba0-93b2-f56910ff4a61 req-12efcc29-499b-4710-b423-1a07163ea41f tempest-TestShelveInstance-494855624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0" returned: 0 in 1.099s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-435fbacf-f3fe-4ba0-93b2-f56910ff4a61 req-12efcc29-499b-4710-b423-1a07163ea41f tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-435fbacf-f3fe-4ba0-93b2-f56910ff4a61 req-12efcc29-499b-4710-b423-1a07163ea41f tempest-TestShelveInstance-494855624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0" returned: 1 in 0.624s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-435fbacf-f3fe-4ba0-93b2-f56910ff4a61 req-12efcc29-499b-4710-b423-1a07163ea41f tempest-TestShelveInstance-494855624 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:43:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-435fbacf-f3fe-4ba0-93b2-f56910ff4a61 req-12efcc29-499b-4710-b423-1a07163ea41f tempest-TestShelveInstance-494855624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.125s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:43:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-435fbacf-f3fe-4ba0-93b2-f56910ff4a61 req-12efcc29-499b-4710-b423-1a07163ea41f tempest-TestShelveInstance-494855624 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-f980558e-5da7-4a6e-90fb-08b2620068f0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ee7c95b-3018-45a3-9ee5-30fafc500658', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:43:07 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-435fbacf-f3fe-4ba0-93b2-f56910ff4a61 req-12efcc29-499b-4710-b423-1a07163ea41f tempest-TestShelveInstance-494855624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:43:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-435fbacf-f3fe-4ba0-93b2-f56910ff4a61 req-12efcc29-499b-4710-b423-1a07163ea41f tempest-TestShelveInstance-494855624 None] attachment_update completed successfully.
Sep 10 19:43:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:43:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:43:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:43:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:43:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:43:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:43:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.135s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:43:17 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:43:17 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:43:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:43:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:44:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:44:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:44:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:44:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:44:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:44:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:44:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:44:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.200s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:44:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:44:43 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-6d3ec7d2-33b8-4ea5-b815-1dc5b4d94862 req-78a80c51-9d2f-48a0-8361-da31a7a3fcdc tempest-TestShelveInstance-494855624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:44:43 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-6d3ec7d2-33b8-4ea5-b815-1dc5b4d94862 req-78a80c51-9d2f-48a0-8361-da31a7a3fcdc tempest-TestShelveInstance-494855624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:44:43 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-6d3ec7d2-33b8-4ea5-b815-1dc5b4d94862 req-78a80c51-9d2f-48a0-8361-da31a7a3fcdc tempest-TestShelveInstance-494855624 None] Terminate volume connection completed successfully.
Sep 10 19:44:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-6d3ec7d2-33b8-4ea5-b815-1dc5b4d94862 req-78a80c51-9d2f-48a0-8361-da31a7a3fcdc tempest-TestShelveInstance-494855624 None] Deleting attachment 1ee7c95b-3018-45a3-9ee5-30fafc500658. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:44:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-b0af0c2a-ccfe-4d2b-b827-f7419fd03c86 req-41b8bdc3-b57b-405a-bc43-071d4924d9f9 tempest-TestShelveInstance-494855624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:44:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-b0af0c2a-ccfe-4d2b-b827-f7419fd03c86 req-41b8bdc3-b57b-405a-bc43-071d4924d9f9 tempest-TestShelveInstance-494855624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:44:51 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[56185f11-61fb-421d-b8e1-ab5e83df52d5]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:44:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-b0af0c2a-ccfe-4d2b-b827-f7419fd03c86 req-41b8bdc3-b57b-405a-bc43-071d4924d9f9 tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:44:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-b0af0c2a-ccfe-4d2b-b827-f7419fd03c86 req-41b8bdc3-b57b-405a-bc43-071d4924d9f9 tempest-TestShelveInstance-494855624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0" returned: 0 in 0.580s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:44:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-b0af0c2a-ccfe-4d2b-b827-f7419fd03c86 req-41b8bdc3-b57b-405a-bc43-071d4924d9f9 tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:44:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-b0af0c2a-ccfe-4d2b-b827-f7419fd03c86 req-41b8bdc3-b57b-405a-bc43-071d4924d9f9 tempest-TestShelveInstance-494855624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0" returned: 1 in 0.506s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:44:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-b0af0c2a-ccfe-4d2b-b827-f7419fd03c86 req-41b8bdc3-b57b-405a-bc43-071d4924d9f9 tempest-TestShelveInstance-494855624 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:44:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-b0af0c2a-ccfe-4d2b-b827-f7419fd03c86 req-41b8bdc3-b57b-405a-bc43-071d4924d9f9 tempest-TestShelveInstance-494855624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.368s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:44:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-b0af0c2a-ccfe-4d2b-b827-f7419fd03c86 req-41b8bdc3-b57b-405a-bc43-071d4924d9f9 tempest-TestShelveInstance-494855624 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-f980558e-5da7-4a6e-90fb-08b2620068f0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de766ba3-0c86-45c2-bacb-8031ea19543a', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:44:52 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-b0af0c2a-ccfe-4d2b-b827-f7419fd03c86 req-41b8bdc3-b57b-405a-bc43-071d4924d9f9 tempest-TestShelveInstance-494855624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:44:52 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-b0af0c2a-ccfe-4d2b-b827-f7419fd03c86 req-41b8bdc3-b57b-405a-bc43-071d4924d9f9 tempest-TestShelveInstance-494855624 None] attachment_update completed successfully.
Sep 10 19:45:02 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:45:02 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:45:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:45:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:45:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:45:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:45:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:45:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:45:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:45:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.399s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:45:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:45:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:46:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Flow 'volume_create_manager' (e4332bc2-416f-47d5-b310-c76cfe8803c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d169a59-6180-42b1-8aff-643f8bf99b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d169a59-6180-42b1-8aff-643f8bf99b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-476234830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d54b4e-bb1f-4099-8d20-8c91d4317a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3daaa8fbb6f74981988ac6e815c0d29f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:03Z,use_quota=True,user_id='8952dab0069a4e73a5aec1baf0ca59dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b9b012-283b-4629-9eb2-6418eae8d61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b9b012-283b-4629-9eb2-6418eae8d61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f7f351-a301-4ecf-9f5e-8c16af29c427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f7f351-a301-4ecf-9f5e-8c16af29c427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d54b4e-bb1f-4099-8d20-8c91d4317a59', 'volume_name': 'volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ad5a8c-9f54-4b17-9227-40e203f0be14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ad5a8c-9f54-4b17-9227-40e203f0be14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6166fd1b-6a1a-4548-b65d-18b340e3191b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:02 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Volume 93d54b4e-bb1f-4099-8d20-8c91d4317a59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59', 'volume_size': 1}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-476234830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d54b4e-bb1f-4099-8d20-8c91d4317a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3daaa8fbb6f74981988ac6e815c0d29f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:03Z,use_quota=True,user_id='8952dab0069a4e73a5aec1baf0ca59dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Creating volume 93d54b4e-bb1f-4099-8d20-8c91d4317a59 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:46:02 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:46:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:03 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=97, name=volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:46:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59 1073741824" returned: 0 in 0.402s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59" returned: 0 in 0.117s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] <== create_volume: return (578ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:46:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.591s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6166fd1b-6a1a-4548-b65d-18b340e3191b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a22245-5d7d-4601-a9d6-8d2e7393dfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:03 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Volume volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59 (93d54b4e-bb1f-4099-8d20-8c91d4317a59): created successfully
Sep 10 19:46:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a22245-5d7d-4601-a9d6-8d2e7393dfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Flow 'volume_create_manager' (e4332bc2-416f-47d5-b310-c76cfe8803c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:03 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3640c51b-126d-4b20-930c-1c4d99ba3a4d tempest-AttachVolumeTestJSON-16455690 None] Created volume successfully.
Sep 10 19:46:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-eb0a93b4-f13d-4c0f-a932-0de4ee83d066 req-fdc9dd10-0a2f-430e-b478-7533bf070ec0 tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-eb0a93b4-f13d-4c0f-a932-0de4ee83d066 req-fdc9dd10-0a2f-430e-b478-7533bf070ec0 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:08 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16f3975-fa22-417a-b6a3-4334cef2c066]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:46:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-eb0a93b4-f13d-4c0f-a932-0de4ee83d066 req-fdc9dd10-0a2f-430e-b478-7533bf070ec0 tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-eb0a93b4-f13d-4c0f-a932-0de4ee83d066 req-fdc9dd10-0a2f-430e-b478-7533bf070ec0 tempest-AttachVolumeTestJSON-16455690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59" returned: 0 in 0.478s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-eb0a93b4-f13d-4c0f-a932-0de4ee83d066 req-fdc9dd10-0a2f-430e-b478-7533bf070ec0 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.549s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-eb0a93b4-f13d-4c0f-a932-0de4ee83d066 req-fdc9dd10-0a2f-430e-b478-7533bf070ec0 tempest-AttachVolumeTestJSON-16455690 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0b48b17-ebd5-4774-a969-dec5e91551f7', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:46:09 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-eb0a93b4-f13d-4c0f-a932-0de4ee83d066 req-fdc9dd10-0a2f-430e-b478-7533bf070ec0 tempest-AttachVolumeTestJSON-16455690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:09 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-eb0a93b4-f13d-4c0f-a932-0de4ee83d066 req-fdc9dd10-0a2f-430e-b478-7533bf070ec0 tempest-AttachVolumeTestJSON-16455690 None] attachment_update completed successfully.
Sep 10 19:46:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:46:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:46:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:46:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.078s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:46:15 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:15 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:46:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Flow 'volume_create_manager' (4c8d9243-ded7-4b5d-a786-d239576757c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105596b9-8044-47f6-a619-e803ef3fb62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105596b9-8044-47f6-a619-e803ef3fb62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1290383587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef73b75e-eb28-44e0-be46-335c21995deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3daaa8fbb6f74981988ac6e815c0d29f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:16Z,use_quota=True,user_id='8952dab0069a4e73a5aec1baf0ca59dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d66eb97-87bd-4f7b-baba-61fbcac08478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d66eb97-87bd-4f7b-baba-61fbcac08478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca31710-5a4b-41f8-86c7-cbb73d5fc8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca31710-5a4b-41f8-86c7-cbb73d5fc8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef73b75e-eb28-44e0-be46-335c21995deb', 'volume_name': 'volume-ef73b75e-eb28-44e0-be46-335c21995deb', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53de0f38-fde3-47b0-8123-53966f753a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53de0f38-fde3-47b0-8123-53966f753a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b40d57a-13d2-426f-87a0-9b34b3575756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Volume ef73b75e-eb28-44e0-be46-335c21995deb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef73b75e-eb28-44e0-be46-335c21995deb', 'volume_size': 1}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1290383587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef73b75e-eb28-44e0-be46-335c21995deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3daaa8fbb6f74981988ac6e815c0d29f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:16Z,use_quota=True,user_id='8952dab0069a4e73a5aec1baf0ca59dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Creating volume ef73b75e-eb28-44e0-be46-335c21995deb {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:46:16 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ef73b75e-eb28-44e0-be46-335c21995deb 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:16 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=98, name=volume-ef73b75e-eb28-44e0-be46-335c21995deb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ef73b75e-eb28-44e0-be46-335c21995deb 1073741824" returned: 0 in 0.305s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ef73b75e-eb28-44e0-be46-335c21995deb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ef73b75e-eb28-44e0-be46-335c21995deb" returned: 0 in 0.078s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] <== create_volume: return (446ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.456s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b40d57a-13d2-426f-87a0-9b34b3575756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef73b75e-eb28-44e0-be46-335c21995deb', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a764cfe8-e955-43bf-a5ff-07c4922473f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Volume volume-ef73b75e-eb28-44e0-be46-335c21995deb (ef73b75e-eb28-44e0-be46-335c21995deb): created successfully
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a764cfe8-e955-43bf-a5ff-07c4922473f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Flow 'volume_create_manager' (4c8d9243-ded7-4b5d-a786-d239576757c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2c68f7f1-4764-4a83-8a79-b1d50dac91e7 tempest-AttachVolumeTestJSON-16455690 None] Created volume successfully.
Sep 10 19:46:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-a06857fe-4e8e-482b-9c59-c776a937fc03 req-06f93885-a649-4ffd-b863-d3570c76af51 tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-a06857fe-4e8e-482b-9c59-c776a937fc03 req-06f93885-a649-4ffd-b863-d3570c76af51 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:23 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3718a55-9e92-40b4-b699-6ede77acf29d]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:46:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-a06857fe-4e8e-482b-9c59-c776a937fc03 req-06f93885-a649-4ffd-b863-d3570c76af51 tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ef73b75e-eb28-44e0-be46-335c21995deb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-a06857fe-4e8e-482b-9c59-c776a937fc03 req-06f93885-a649-4ffd-b863-d3570c76af51 tempest-AttachVolumeTestJSON-16455690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ef73b75e-eb28-44e0-be46-335c21995deb" returned: 0 in 0.655s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-a06857fe-4e8e-482b-9c59-c776a937fc03 req-06f93885-a649-4ffd-b863-d3570c76af51 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.712s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-a06857fe-4e8e-482b-9c59-c776a937fc03 req-06f93885-a649-4ffd-b863-d3570c76af51 tempest-AttachVolumeTestJSON-16455690 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-ef73b75e-eb28-44e0-be46-335c21995deb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd7a013a-a2b1-4f41-967f-c747d5134ca7', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:46:24 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-a06857fe-4e8e-482b-9c59-c776a937fc03 req-06f93885-a649-4ffd-b863-d3570c76af51 tempest-AttachVolumeTestJSON-16455690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:24 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-a06857fe-4e8e-482b-9c59-c776a937fc03 req-06f93885-a649-4ffd-b863-d3570c76af51 tempest-AttachVolumeTestJSON-16455690 None] attachment_update completed successfully.
Sep 10 19:46:30 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-b8e4a432-a2e1-445a-9a9b-bd11509a927f tempest-TestShelveInstance-494855624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:30 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-b8e4a432-a2e1-445a-9a9b-bd11509a927f tempest-TestShelveInstance-494855624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:30 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-b8e4a432-a2e1-445a-9a9b-bd11509a927f tempest-TestShelveInstance-494855624 None] Terminate volume connection completed successfully.
Sep 10 19:46:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-b8e4a432-a2e1-445a-9a9b-bd11509a927f tempest-TestShelveInstance-494855624 None] Deleting attachment de766ba3-0c86-45c2-bacb-8031ea19543a. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:46:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Acquiring lock "cinder-f980558e-5da7-4a6e-90fb-08b2620068f0-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:46:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Lock "cinder-f980558e-5da7-4a6e-90fb-08b2620068f0-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:46:31 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Acquiring lock "cinder-quobyte-f980558e-5da7-4a6e-90fb-08b2620068f0" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:46:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Lock "cinder-quobyte-f980558e-5da7-4a6e-90fb-08b2620068f0" acquired by "delete_volume" :: waited 0.020s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:46:31 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c701f4-d2b6-4c3a-90e2-f0a902d99ea9]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:46:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0" returned: 0 in 0.410s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0" returned: 1 in 0.418s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:46:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f980558e-5da7-4a6e-90fb-08b2620068f0" returned: 0 in 0.162s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Lock "cinder-quobyte-f980558e-5da7-4a6e-90fb-08b2620068f0" released by "delete_volume" :: held 1.311s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:46:32 devstack cinder-volume[82850]: DEBUG cinder.quota [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Created reservations ['4365bda9-8a62-45c8-a5c6-e395acbac177', 'd2035a55-67a4-4f53-8bf7-f93f1401e122', 'c68d7b34-aeb8-4b8e-9bee-95303b132521', 'ffbf204f-174d-44d6-8255-1f05658eec7f'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:46:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:46:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:46:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.131s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:33 devstack cinder-volume[82850]: DEBUG cinder.manager [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:46:33 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Deleted volume successfully.
Sep 10 19:46:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-d00aa45e-12f4-4166-a7c2-d27248774e89 req-8e5c5fb9-5411-45fa-900b-0e7f584fc4ce tempest-TestShelveInstance-494855624 None] Lock "cinder-f980558e-5da7-4a6e-90fb-08b2620068f0-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:46:42 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=24,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:46:43 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=13,cinder:SELECT=14,cinder:DELETE=2,cinder:INSERT=3 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:46:48 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Flow 'volume_create_manager' (a3b85987-f15e-41b0-b2c1-aab549720a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2504d27c-19c0-4590-b19a-c3a4b7641e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2504d27c-19c0-4590-b19a-c3a4b7641e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1624988708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60e45fb-a2d7-4161-95b2-614076200147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1741a43fa943435e8ca402fc393a0c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:49Z,use_quota=True,user_id='720ea384fc664e4295944139cdb93b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66589b95-3464-4c32-9a7a-a48d328ece28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66589b95-3464-4c32-9a7a-a48d328ece28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f0bf31-2cf2-4e99-93e5-527d320247f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f0bf31-2cf2-4e99-93e5-527d320247f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd60e45fb-a2d7-4161-95b2-614076200147', 'volume_name': 'volume-d60e45fb-a2d7-4161-95b2-614076200147', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ba4158-7012-4c0e-a586-815be4ce52c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ba4158-7012-4c0e-a586-815be4ce52c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0015bda-7b27-4aa2-af56-7120fd03b3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:49 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume d60e45fb-a2d7-4161-95b2-614076200147: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d60e45fb-a2d7-4161-95b2-614076200147', 'volume_size': 1}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1624988708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60e45fb-a2d7-4161-95b2-614076200147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1741a43fa943435e8ca402fc393a0c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:49Z,use_quota=True,user_id='720ea384fc664e4295944139cdb93b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Creating volume d60e45fb-a2d7-4161-95b2-614076200147 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:46:49 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:49 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=99, name=volume-d60e45fb-a2d7-4161-95b2-614076200147, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147 1073741824" returned: 0 in 0.330s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147" returned: 0 in 0.085s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] <== create_volume: return (482ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.494s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0015bda-7b27-4aa2-af56-7120fd03b3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60e45fb-a2d7-4161-95b2-614076200147', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8914d7-9829-4faf-b75b-a76d2db840bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:49 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume volume-d60e45fb-a2d7-4161-95b2-614076200147 (d60e45fb-a2d7-4161-95b2-614076200147): created successfully
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8914d7-9829-4faf-b75b-a76d2db840bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Flow 'volume_create_manager' (a3b85987-f15e-41b0-b2c1-aab549720a69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:49 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-962c4710-d227-48d3-838b-ff5f200b22b9 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Created volume successfully.
Sep 10 19:46:51 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Creating offline snapshot e7402d5d-14e9-42e4-a8fc-84596df0a2fd of volume d60e45fb-a2d7-4161-95b2-614076200147 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:46:51 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7c84bd-3ecf-45b6-8c57-8b3f9dbedd88]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:46:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147" returned: 0 in 0.404s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:52 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=100, name=volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:46:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd 1G" returned: 0 in 0.236s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d60e45fb-a2d7-4161-95b2-614076200147 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "qemu-img rebase -u -b volume-d60e45fb-a2d7-4161-95b2-614076200147 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd" returned: 0 in 0.138s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:46:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd" returned: 0 in 0.088s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:46:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd" returned: 0 in 0.100s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.info" returned: 0 in 0.090s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:46:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.info" returned: 0 in 0.083s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.478s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:53 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d886a645-f55c-41f2-b126-7f61966f39f3 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Create snapshot completed successfully
Sep 10 19:46:53 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-6cb084ba-c31c-40fe-a840-b97472aa3ce0 req-c33172fb-ee85-4349-b815-0ea4ede00608 tempest-AttachVolumeTestJSON-16455690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:53 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-6cb084ba-c31c-40fe-a840-b97472aa3ce0 req-c33172fb-ee85-4349-b815-0ea4ede00608 tempest-AttachVolumeTestJSON-16455690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:53 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-6cb084ba-c31c-40fe-a840-b97472aa3ce0 req-c33172fb-ee85-4349-b815-0ea4ede00608 tempest-AttachVolumeTestJSON-16455690 None] Terminate volume connection completed successfully.
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-6cb084ba-c31c-40fe-a840-b97472aa3ce0 req-c33172fb-ee85-4349-b815-0ea4ede00608 tempest-AttachVolumeTestJSON-16455690 None] Deleting attachment c0b48b17-ebd5-4774-a969-dec5e91551f7. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:46:53 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Flow 'volume_create_manager' (fd6616fc-b17e-4363-b4aa-c35c6f209e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbf0c01-d2c3-4432-8756-d07cb6a47413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbf0c01-d2c3-4432-8756-d07cb6a47413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2126607889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e54e23c-0141-41eb-9872-a59a8a492ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1741a43fa943435e8ca402fc393a0c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:54Z,use_quota=True,user_id='720ea384fc664e4295944139cdb93b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5821aa87-9ee6-4b6b-89af-9c7009a21011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5821aa87-9ee6-4b6b-89af-9c7009a21011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724ade40-92f2-4367-b446-ad299847f54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724ade40-92f2-4367-b446-ad299847f54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e54e23c-0141-41eb-9872-a59a8a492ca8', 'volume_name': 'volume-4e54e23c-0141-41eb-9872-a59a8a492ca8', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a647262-2f11-40c8-933c-28c1ead5527d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a647262-2f11-40c8-933c-28c1ead5527d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675528df-8d2c-4a2d-81ec-7f7062ac6233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:53 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume 4e54e23c-0141-41eb-9872-a59a8a492ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e54e23c-0141-41eb-9872-a59a8a492ca8', 'volume_size': 1}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2126607889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e54e23c-0141-41eb-9872-a59a8a492ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1741a43fa943435e8ca402fc393a0c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:54Z,use_quota=True,user_id='720ea384fc664e4295944139cdb93b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Creating volume 4e54e23c-0141-41eb-9872-a59a8a492ca8 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:46:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:46:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:46:54 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:46:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4e54e23c-0141-41eb-9872-a59a8a492ca8 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:54 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=102, name=volume-4e54e23c-0141-41eb-9872-a59a8a492ca8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:46:54 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:54 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:46:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Flow 'volume_create_manager' (71acb94c-fd24-4f70-aaf6-69ec8f2704f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b405b7-7a52-4c64-9452-f1a2b6cd1698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4e54e23c-0141-41eb-9872-a59a8a492ca8 1073741824" returned: 0 in 0.847s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4e54e23c-0141-41eb-9872-a59a8a492ca8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b405b7-7a52-4c64-9452-f1a2b6cd1698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1401249645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde547f2-a04e-4a8c-81e9-e34038b652f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1741a43fa943435e8ca402fc393a0c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:54Z,use_quota=True,user_id='720ea384fc664e4295944139cdb93b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ebcf8c-d11c-4144-ae0a-290a66b641b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ebcf8c-d11c-4144-ae0a-290a66b641b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57947bc-596f-4ae9-8089-79718fbd5ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57947bc-596f-4ae9-8089-79718fbd5ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde547f2-a04e-4a8c-81e9-e34038b652f0', 'volume_name': 'volume-dde547f2-a04e-4a8c-81e9-e34038b652f0', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3020bf10-145a-42a1-ab1e-d7ba4ca925cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3020bf10-145a-42a1-ab1e-d7ba4ca925cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f028bb-40b2-4385-ae7f-8f142afaf938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:55 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume dde547f2-a04e-4a8c-81e9-e34038b652f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde547f2-a04e-4a8c-81e9-e34038b652f0', 'volume_size': 1}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:55 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Flow 'volume_create_manager' (f1194673-d483-486c-8292-b6d3aebc8cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b854500-367d-48ae-93b1-5d2255aa2168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b854500-367d-48ae-93b1-5d2255aa2168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1802838869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46dddbbf-84e6-47ae-a1c5-7430976ea796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1741a43fa943435e8ca402fc393a0c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:55Z,use_quota=True,user_id='720ea384fc664e4295944139cdb93b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0961c03-9181-4a35-a6bb-5347619fa3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0961c03-9181-4a35-a6bb-5347619fa3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01ac8e0-1fe4-4f3d-bb91-7b370beee1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01ac8e0-1fe4-4f3d-bb91-7b370beee1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46dddbbf-84e6-47ae-a1c5-7430976ea796', 'volume_name': 'volume-46dddbbf-84e6-47ae-a1c5-7430976ea796', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ad7133-3137-4c9f-b73e-a25b4f036a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ad7133-3137-4c9f-b73e-a25b4f036a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29d9d93-0412-4fad-8bc4-a4e315f33eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:55 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume 46dddbbf-84e6-47ae-a1c5-7430976ea796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46dddbbf-84e6-47ae-a1c5-7430976ea796', 'volume_size': 1}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4e54e23c-0141-41eb-9872-a59a8a492ca8" returned: 0 in 0.780s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] <== create_volume: return (1647ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.354s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1401249645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde547f2-a04e-4a8c-81e9-e34038b652f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1741a43fa943435e8ca402fc393a0c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:54Z,use_quota=True,user_id='720ea384fc664e4295944139cdb93b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Creating volume dde547f2-a04e-4a8c-81e9-e34038b652f0 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:46:55 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:46:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dde547f2-a04e-4a8c-81e9-e34038b652f0 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:55 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=103, name=volume-dde547f2-a04e-4a8c-81e9-e34038b652f0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:46:56 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Flow 'volume_create_manager' (0b07ccbd-fb4a-4798-8ae4-12252142ee5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24496bba-7a11-477e-8f66-cd6138465db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675528df-8d2c-4a2d-81ec-7f7062ac6233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e54e23c-0141-41eb-9872-a59a8a492ca8', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b043c5e-4c46-4733-bb8d-eea2294cb8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24496bba-7a11-477e-8f66-cd6138465db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-208855208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b45e32c1-cfa5-48e9-b15f-e9c23ba752c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1741a43fa943435e8ca402fc393a0c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:55Z,use_quota=True,user_id='720ea384fc664e4295944139cdb93b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a66e6a3-9a3c-4c3f-a660-cd27c34a716b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a66e6a3-9a3c-4c3f-a660-cd27c34a716b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edea6b6-d1f3-46fc-9315-4af9bdae855f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edea6b6-d1f3-46fc-9315-4af9bdae855f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b45e32c1-cfa5-48e9-b15f-e9c23ba752c9', 'volume_name': 'volume-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c557b9-e56b-48f5-89af-8e7eb9c272f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c557b9-e56b-48f5-89af-8e7eb9c272f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc1e51e-1f75-4150-907b-e0b3113dbd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:56 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume b45e32c1-cfa5-48e9-b15f-e9c23ba752c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9', 'volume_size': 1}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dde547f2-a04e-4a8c-81e9-e34038b652f0 1073741824" returned: 0 in 0.679s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dde547f2-a04e-4a8c-81e9-e34038b652f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:56 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume volume-4e54e23c-0141-41eb-9872-a59a8a492ca8 (4e54e23c-0141-41eb-9872-a59a8a492ca8): created successfully
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b043c5e-4c46-4733-bb8d-eea2294cb8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Flow 'volume_create_manager' (fd6616fc-b17e-4363-b4aa-c35c6f209e09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dde547f2-a04e-4a8c-81e9-e34038b652f0" returned: 0 in 0.422s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] <== create_volume: return (1121ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.190s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1802838869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46dddbbf-84e6-47ae-a1c5-7430976ea796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1741a43fa943435e8ca402fc393a0c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:55Z,use_quota=True,user_id='720ea384fc664e4295944139cdb93b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Creating volume 46dddbbf-84e6-47ae-a1c5-7430976ea796 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:46:56 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:46:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-46dddbbf-84e6-47ae-a1c5-7430976ea796 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:56 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:56 devstack quobyte-client[82855]: System call of process 96023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:46:57 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=104, name=volume-46dddbbf-84e6-47ae-a1c5-7430976ea796, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Flow 'volume_create_manager' (8c647d81-7e45-46f8-a360-238a0ddb78d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c748ba6-8e5c-4500-a5a7-bacfe5d2a359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c748ba6-8e5c-4500-a5a7-bacfe5d2a359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-587563905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f076fa-314e-478c-b059-67c187828053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1741a43fa943435e8ca402fc393a0c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:56Z,use_quota=True,user_id='720ea384fc664e4295944139cdb93b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379b0fb2-92e5-407e-8e66-f1b8bb7eac8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379b0fb2-92e5-407e-8e66-f1b8bb7eac8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2c7521-02e8-4983-944b-50050ed748a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2c7521-02e8-4983-944b-50050ed748a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f076fa-314e-478c-b059-67c187828053', 'volume_name': 'volume-f0f076fa-314e-478c-b059-67c187828053', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1304f508-11dc-49ff-9495-6e387976a89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1304f508-11dc-49ff-9495-6e387976a89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157267d3-41b5-4499-b592-63be30c95c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:57 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume f0f076fa-314e-478c-b059-67c187828053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f076fa-314e-478c-b059-67c187828053', 'volume_size': 1}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:57 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c64f3265-638f-4fb7-a706-4c012f9220e7 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Created volume successfully.
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f028bb-40b2-4385-ae7f-8f142afaf938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde547f2-a04e-4a8c-81e9-e34038b652f0', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a05ecd-8236-4435-8fcb-8555060d665c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-46dddbbf-84e6-47ae-a1c5-7430976ea796 1073741824" returned: 0 in 0.737s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-46dddbbf-84e6-47ae-a1c5-7430976ea796 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:57 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume volume-dde547f2-a04e-4a8c-81e9-e34038b652f0 (dde547f2-a04e-4a8c-81e9-e34038b652f0): created successfully
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a05ecd-8236-4435-8fcb-8555060d665c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Flow 'volume_create_manager' (71acb94c-fd24-4f70-aaf6-69ec8f2704f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-46dddbbf-84e6-47ae-a1c5-7430976ea796" returned: 0 in 0.323s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] <== create_volume: return (1081ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.577s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-208855208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b45e32c1-cfa5-48e9-b15f-e9c23ba752c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1741a43fa943435e8ca402fc393a0c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:55Z,use_quota=True,user_id='720ea384fc664e4295944139cdb93b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Creating volume b45e32c1-cfa5-48e9-b15f-e9c23ba752c9 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:46:57 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:46:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:58 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=105, name=volume-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:46:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4d7004ec-069c-476f-a4a3-43d5728959ab tempest-CreateVolumesFromSnapshotTest-1795069182 None] Created volume successfully.
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29d9d93-0412-4fad-8bc4-a4e315f33eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46dddbbf-84e6-47ae-a1c5-7430976ea796', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ee71fd-a099-48ba-be69-2430da60ef5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9 1073741824" returned: 0 in 0.444s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:58 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume volume-46dddbbf-84e6-47ae-a1c5-7430976ea796 (46dddbbf-84e6-47ae-a1c5-7430976ea796): created successfully
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ee71fd-a099-48ba-be69-2430da60ef5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Flow 'volume_create_manager' (f1194673-d483-486c-8292-b6d3aebc8cbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9" returned: 0 in 0.333s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] <== create_volume: return (803ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.257s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-587563905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f076fa-314e-478c-b059-67c187828053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1741a43fa943435e8ca402fc393a0c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:46:56Z,use_quota=True,user_id='720ea384fc664e4295944139cdb93b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Creating volume f0f076fa-314e-478c-b059-67c187828053 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:46:58 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f0f076fa-314e-478c-b059-67c187828053 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:58 devstack quobyte-client[82855]: System call of process 96035 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:46:58 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=106, name=volume-f0f076fa-314e-478c-b059-67c187828053, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:46:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc1e51e-1f75-4150-907b-e0b3113dbd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72aed913-1e13-49f8-a1bd-177134663467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a2df11a1-3f0b-4f05-98c9-e2f0840f88ec tempest-CreateVolumesFromSnapshotTest-1795069182 None] Created volume successfully.
Sep 10 19:46:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f0f076fa-314e-478c-b059-67c187828053 1073741824" returned: 0 in 0.390s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f0f076fa-314e-478c-b059-67c187828053 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:59 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume volume-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9 (b45e32c1-cfa5-48e9-b15f-e9c23ba752c9): created successfully
Sep 10 19:46:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72aed913-1e13-49f8-a1bd-177134663467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Flow 'volume_create_manager' (0b07ccbd-fb4a-4798-8ae4-12252142ee5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f0f076fa-314e-478c-b059-67c187828053" returned: 0 in 0.300s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] <== create_volume: return (714ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:46:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b147067f-63a4-45b5-9d61-d1bf3e70c5b2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Created volume successfully.
Sep 10 19:46:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157267d3-41b5-4499-b592-63be30c95c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f076fa-314e-478c-b059-67c187828053', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f720f32-bb22-432c-aa8a-69e6c1e35b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:46:59 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume volume-f0f076fa-314e-478c-b059-67c187828053 (f0f076fa-314e-478c-b059-67c187828053): created successfully
Sep 10 19:46:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f720f32-bb22-432c-aa8a-69e6c1e35b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:46:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Flow 'volume_create_manager' (8c647d81-7e45-46f8-a360-238a0ddb78d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:46:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c1aed12c-083c-47fb-b4b7-c46f68709be8 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Created volume successfully.
Sep 10 19:46:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "cinder-f0f076fa-314e-478c-b059-67c187828053-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:46:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-f0f076fa-314e-478c-b059-67c187828053-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:00 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "cinder-quobyte-f0f076fa-314e-478c-b059-67c187828053" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-f0f076fa-314e-478c-b059-67c187828053" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:00 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef05040-98b5-41ca-b0ba-e27898d58f05]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f0f076fa-314e-478c-b059-67c187828053 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f0f076fa-314e-478c-b059-67c187828053" returned: 0 in 0.417s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f0f076fa-314e-478c-b059-67c187828053 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f0f076fa-314e-478c-b059-67c187828053" returned: 0 in 0.089s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-f0f076fa-314e-478c-b059-67c187828053" released by "delete_volume" :: held 0.675s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:01 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Created reservations ['e48e7dfe-1e38-4f07-8607-c1d297983a30', '0eaa0edd-63d4-4f7c-bd1d-0a01c969ea76', '2c98f80e-bac6-46c6-b936-f5a93b3452a1', '294fa83a-0d32-46ec-a506-57ce8cf5c25a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:47:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.087s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:01 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:47:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Deleted volume successfully.
Sep 10 19:47:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cfffab12-f8fc-43e4-9817-6495f8f632f1 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-f0f076fa-314e-478c-b059-67c187828053-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "cinder-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "cinder-quobyte-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:02 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf0b4c1-2952-4bee-a8cc-b92e96f703e1]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9" returned: 0 in 0.396s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9" returned: 0 in 0.084s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9" released by "delete_volume" :: held 0.644s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:03 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Created reservations ['9f2b0082-6fb0-474a-8d13-cb421891ec21', 'ab3def2c-9b2f-4cb1-a00b-3268f68ee562', 'd8be3682-da07-4916-af7c-e3491c3cb716', '08386d18-c186-4129-8195-f67478fd0674'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:47:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.100s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:03 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:47:03 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Deleted volume successfully.
Sep 10 19:47:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6730b6ce-e109-4139-9420-aa5acad8421f tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-b45e32c1-cfa5-48e9-b15f-e9c23ba752c9-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "cinder-46dddbbf-84e6-47ae-a1c5-7430976ea796-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-46dddbbf-84e6-47ae-a1c5-7430976ea796-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:04 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "cinder-quobyte-46dddbbf-84e6-47ae-a1c5-7430976ea796" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-46dddbbf-84e6-47ae-a1c5-7430976ea796" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:04 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b01963d-2d65-44ae-a253-5ab794c3100c]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-46dddbbf-84e6-47ae-a1c5-7430976ea796 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-46dddbbf-84e6-47ae-a1c5-7430976ea796" returned: 0 in 0.400s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-46dddbbf-84e6-47ae-a1c5-7430976ea796 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-46dddbbf-84e6-47ae-a1c5-7430976ea796" returned: 0 in 0.101s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-46dddbbf-84e6-47ae-a1c5-7430976ea796" released by "delete_volume" :: held 0.651s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:05 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Created reservations ['7301c57e-edfc-456c-910d-902bf79a20f7', 'd6f6c7fe-abed-47ab-b57a-ffe0213503c5', '01da4259-158b-4399-a2c3-cf75e56327e3', 'f84f74fe-71ab-4a7a-a068-d84341cfdfff'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:47:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.082s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:05 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:47:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Deleted volume successfully.
Sep 10 19:47:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b29bb60d-9a88-48d9-88d6-f41d9b84f119 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-46dddbbf-84e6-47ae-a1c5-7430976ea796-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "cinder-dde547f2-a04e-4a8c-81e9-e34038b652f0-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-dde547f2-a04e-4a8c-81e9-e34038b652f0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:06 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "cinder-quobyte-dde547f2-a04e-4a8c-81e9-e34038b652f0" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-dde547f2-a04e-4a8c-81e9-e34038b652f0" acquired by "delete_volume" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d96dc4-7bfa-44ff-b419-8731d4dc2a2c]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dde547f2-a04e-4a8c-81e9-e34038b652f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dde547f2-a04e-4a8c-81e9-e34038b652f0" returned: 0 in 0.421s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dde547f2-a04e-4a8c-81e9-e34038b652f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dde547f2-a04e-4a8c-81e9-e34038b652f0" returned: 0 in 0.084s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-dde547f2-a04e-4a8c-81e9-e34038b652f0" released by "delete_volume" :: held 0.648s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:07 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Created reservations ['da9c8eae-ca45-4f5b-95db-8c028fea68b1', '266dc073-fcad-4a17-920a-014c2d0fe690', 'e912bf15-114f-4c58-b4a6-472a8bfc38f5', '3f17086b-a643-4013-a158-d0bf452c8675'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:47:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.081s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:08 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:47:08 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Deleted volume successfully.
Sep 10 19:47:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1c903bb1-bed4-42c5-be0e-62d7bf457ae2 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-dde547f2-a04e-4a8c-81e9-e34038b652f0-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "cinder-4e54e23c-0141-41eb-9872-a59a8a492ca8-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-4e54e23c-0141-41eb-9872-a59a8a492ca8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:09 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "cinder-quobyte-4e54e23c-0141-41eb-9872-a59a8a492ca8" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-4e54e23c-0141-41eb-9872-a59a8a492ca8" acquired by "delete_volume" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:09 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f7ac17-bcb6-4c55-9f1f-6256bbb75176]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4e54e23c-0141-41eb-9872-a59a8a492ca8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4e54e23c-0141-41eb-9872-a59a8a492ca8" returned: 0 in 0.411s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4e54e23c-0141-41eb-9872-a59a8a492ca8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-4e54e23c-0141-41eb-9872-a59a8a492ca8" returned: 0 in 0.085s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-4e54e23c-0141-41eb-9872-a59a8a492ca8" released by "delete_volume" :: held 0.656s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:10 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Created reservations ['e7e16e55-7b2c-454d-9742-fcd7e753870e', 'c3f332b9-1912-40fc-a56e-eb7e2af6c8be', 'd226c7fd-ddbb-4166-b1c3-5fb464ae71b4', '61a8e1b6-b4fc-4158-8b1b-b7bbdcbb6c3e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:47:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.082s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:10 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:47:10 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Deleted volume successfully.
Sep 10 19:47:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-656e0cf5-f117-415b-9b05-2aa91b470ed5 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-4e54e23c-0141-41eb-9872-a59a8a492ca8-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "cinder-e7402d5d-14e9-42e4-a8fc-84596df0a2fd-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-e7402d5d-14e9-42e4-a8fc-84596df0a2fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:11 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "cinder-quobyte-d60e45fb-a2d7-4161-95b2-614076200147" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-d60e45fb-a2d7-4161-95b2-614076200147" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "cinder-quobyte-e7402d5d-14e9-42e4-a8fc-84596df0a2fd" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-e7402d5d-14e9-42e4-a8fc-84596df0a2fd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Deleting offline snapshot e7402d5d-14e9-42e4-a8fc-84596df0a2fd of volume d60e45fb-a2d7-4161-95b2-614076200147 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:47:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] snapshot_file for this snap is: volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:47:11 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a72f75-eaa3-40e2-851d-b307724d2dc5]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd" returned: 0 in 0.409s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d60e45fb-a2d7-4161-95b2-614076200147(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:47:12 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e73a1e-6424-465b-b453-5c0b33a3a8d7]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147" returned: 0 in 0.365s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd" returned: 0 in 0.238s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147.e7402d5d-14e9-42e4-a8fc-84596df0a2fd" returned: 0 in 0.101s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-e7402d5d-14e9-42e4-a8fc-84596df0a2fd" released by "_delete_snapshot" :: held 1.446s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-d60e45fb-a2d7-4161-95b2-614076200147" released by "delete_snapshot" :: held 1.478s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:13 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Created reservations ['ad5ad3b0-952b-4f59-b000-8da579880dca', '8b5f26fe-4206-4d96-8d9f-a018a7697598', '86b180b5-3b86-4f92-b8fb-4b429a1ae8ee', '8c5a75d8-7246-4b05-98bb-af0b543e3547'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:47:13 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Delete snapshot completed successfully.
Sep 10 19:47:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d282948-bacc-42f9-b72f-941ba6f0cd14 tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-e7402d5d-14e9-42e4-a8fc-84596df0a2fd-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "cinder-d60e45fb-a2d7-4161-95b2-614076200147-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-d60e45fb-a2d7-4161-95b2-614076200147-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:13 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "cinder-quobyte-d60e45fb-a2d7-4161-95b2-614076200147" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-d60e45fb-a2d7-4161-95b2-614076200147" acquired by "delete_volume" :: waited 0.021s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:13 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d4435c-44a1-46d0-ba0e-a3a7ad010cc5]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147" returned: 0 in 0.396s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:47:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d60e45fb-a2d7-4161-95b2-614076200147" returned: 0 in 0.224s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-quobyte-d60e45fb-a2d7-4161-95b2-614076200147" released by "delete_volume" :: held 0.798s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.295s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:47:14 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Created reservations ['0a9a3478-09de-4e7f-9c17-86b4e6c65965', '6d3e6d98-2dc3-4450-ac67-d8405291a289', '196884a6-4814-4c43-a850-7ecaf6be8f82', '303873bd-9e58-43db-8d22-6118d224ff48'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:47:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.083s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:15 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:47:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Deleted volume successfully.
Sep 10 19:47:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-31df2119-3acd-4e6f-b5d5-e3de8c20a15d tempest-CreateVolumesFromSnapshotTest-1795069182 None] Lock "cinder-d60e45fb-a2d7-4161-95b2-614076200147-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:17 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-2de91442-9dc9-44c3-bb57-ee7700f5f061 req-cf87aa50-947b-4e4f-9e51-ecd2e3f50f9f tempest-AttachVolumeTestJSON-16455690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:18 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-2de91442-9dc9-44c3-bb57-ee7700f5f061 req-cf87aa50-947b-4e4f-9e51-ecd2e3f50f9f tempest-AttachVolumeTestJSON-16455690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:18 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-2de91442-9dc9-44c3-bb57-ee7700f5f061 req-cf87aa50-947b-4e4f-9e51-ecd2e3f50f9f tempest-AttachVolumeTestJSON-16455690 None] Terminate volume connection completed successfully.
Sep 10 19:47:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-2de91442-9dc9-44c3-bb57-ee7700f5f061 req-cf87aa50-947b-4e4f-9e51-ecd2e3f50f9f tempest-AttachVolumeTestJSON-16455690 None] Deleting attachment fd7a013a-a2b1-4f41-967f-c747d5134ca7. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:47:24 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:24 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:47:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Flow 'volume_create_manager' (eb286c99-02f7-4eb8-9704-f9f5079931e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:47:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50587e8-1e80-4b97-a83f-d72445b42e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50587e8-1e80-4b97-a83f-d72445b42e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff14768-30b1-4b41-9984-ebc339acdff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9ef070177440fb92cae178a5f84109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:47:25Z,use_quota=True,user_id='f363fbe053d348a0a61b0366b0fe91c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd9cd04-1068-42a9-866a-7d0dcb7cffce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd9cd04-1068-42a9-866a-7d0dcb7cffce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fa41f7-f9e4-4eea-bf5a-69406c44dd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fa41f7-f9e4-4eea-bf5a-69406c44dd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cff14768-30b1-4b41-9984-ebc339acdff3', 'volume_name': 'volume-cff14768-30b1-4b41-9984-ebc339acdff3', 'volume_size': 1, 'image_id': 'c209ee8f-5e98-4ada-a9d3-935540fc817f', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '32fad6dc045e1067e0c7b1b920f242fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c9ef070177440fb92cae178a5f84109', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '08965b6d503d16003364f4e3bdda47c16a1e9d12f485ed4784e71af91d3e4f182176cf096c665cc96229cf6328db3abbaaab45fdaeda79fdb2ae8b9215e533a9', 'id': 'c209ee8f-5e98-4ada-a9d3-935540fc817f', 'created_at': datetime.datetime(2025, 9, 10, 17, 47, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c209ee8f-5e98-4ada-a9d3-935540fc817f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc56e6b8be0>}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c842d0c-35cb-40fc-a3a4-21ddb100120c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c842d0c-35cb-40fc-a3a4-21ddb100120c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0f5fdf-3a5a-41c2-9217-d21ceccd5d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:25 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Volume cff14768-30b1-4b41-9984-ebc339acdff3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cff14768-30b1-4b41-9984-ebc339acdff3', 'volume_size': 1, 'image_id': 'c209ee8f-5e98-4ada-a9d3-935540fc817f', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '32fad6dc045e1067e0c7b1b920f242fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c9ef070177440fb92cae178a5f84109', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '08965b6d503d16003364f4e3bdda47c16a1e9d12f485ed4784e71af91d3e4f182176cf096c665cc96229cf6328db3abbaaab45fdaeda79fdb2ae8b9215e533a9', 'id': 'c209ee8f-5e98-4ada-a9d3-935540fc817f', 'created_at': datetime.datetime(2025, 9, 10, 17, 47, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c209ee8f-5e98-4ada-a9d3-935540fc817f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc56e6b8be0>}
Sep 10 19:47:25 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Cloning cff14768-30b1-4b41-9984-ebc339acdff3 from image c209ee8f-5e98-4ada-a9d3-935540fc817f  at location (None, None). {{(pid=82850) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 19:47:25 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 19:47:25 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Image download 0.00 MB at 0.00 MB/s
Sep 10 19:47:25 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b12b683-91a2-41e3-a6a4-d00242080dd7]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:25 devstack sudo[96172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD
Sep 10 19:47:25 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:47:27 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root
Sep 10 19:47:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD" returned: 0 in 2.518s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:28 devstack sudo[96182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD
Sep 10 19:47:28 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:47:30 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root
Sep 10 19:47:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD" returned: 1 in 2.355s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:47:30 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Temporary image c209ee8f-5e98-4ada-a9d3-935540fc817f is fetched for user f363fbe053d348a0a61b0366b0fe91c0. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 19:47:30 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3f19c2-1877-491d-9dd6-d0a6a9e23ff3]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:30 devstack sudo[96188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD
Sep 10 19:47:30 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:47:32 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root
Sep 10 19:47:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD" returned: 0 in 2.491s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "cinder-ef73b75e-eb28-44e0-be46-335c21995deb-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Lock "cinder-ef73b75e-eb28-44e0-be46-335c21995deb-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:33 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "cinder-quobyte-ef73b75e-eb28-44e0-be46-335c21995deb" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:33 devstack sudo[96193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD
Sep 10 19:47:33 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:47:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Lock "cinder-quobyte-ef73b75e-eb28-44e0-be46-335c21995deb" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:33 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fb1f78-e816-42cb-bb11-a6fa1740dbbc]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ef73b75e-eb28-44e0-be46-335c21995deb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ef73b75e-eb28-44e0-be46-335c21995deb" returned: 0 in 0.528s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ef73b75e-eb28-44e0-be46-335c21995deb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ef73b75e-eb28-44e0-be46-335c21995deb" returned: 0 in 0.117s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Lock "cinder-quobyte-ef73b75e-eb28-44e0-be46-335c21995deb" released by "delete_volume" :: held 0.841s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:34 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Created reservations ['0f03f415-838e-47d7-97f1-3ea8504db312', '9ea329ef-5dd5-482c-996c-1457fe5143a3', '2c838719-8cda-48bb-a30c-754f94fee047', '376577ad-edec-419f-9866-90bc8efc3f36'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:47:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.130s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:47:35 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Deleted volume successfully.
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "cinder-93d54b4e-bb1f-4099-8d20-8c91d4317a59-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Lock "cinder-93d54b4e-bb1f-4099-8d20-8c91d4317a59-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-83f00cae-563c-4c3d-aae7-9d2b722bd33f tempest-AttachVolumeTestJSON-16455690 None] Lock "cinder-ef73b75e-eb28-44e0-be46-335c21995deb-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:35 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD" returned: 1 in 2.872s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff14768-30b1-4b41-9984-ebc339acdff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9ef070177440fb92cae178a5f84109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:47:25Z,use_quota=True,user_id='f363fbe053d348a0a61b0366b0fe91c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Creating volume cff14768-30b1-4b41-9984-ebc339acdff3 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:47:35 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:47:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:36 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=107, name=volume-cff14768-30b1-4b41-9984-ebc339acdff3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:47:36 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "cinder-quobyte-93d54b4e-bb1f-4099-8d20-8c91d4317a59" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3 1073741824" returned: 0 in 0.467s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Lock "cinder-quobyte-93d54b4e-bb1f-4099-8d20-8c91d4317a59" acquired by "delete_volume" :: waited 0.218s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3" returned: 0 in 0.237s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] <== create_volume: return (722ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:47:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:36 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3137eb-7ac1-4fde-b0f1-8906a49c7fa3]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:37 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Attempting download of c209ee8f-5e98-4ada-a9d3-935540fc817f ((None, None)) to volume cff14768-30b1-4b41-9984-ebc339acdff3. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 19:47:37 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8617a352-8db2-47ef-8d9f-0efee40f1fb6]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c209ee8f-5e98-4ada-a9d3-935540fc817f_xi4jiy_w {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59" returned: 0 in 0.557s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-93d54b4e-bb1f-4099-8d20-8c91d4317a59" returned: 0 in 0.104s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Lock "cinder-quobyte-93d54b4e-bb1f-4099-8d20-8c91d4317a59" released by "delete_volume" :: held 0.977s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c209ee8f-5e98-4ada-a9d3-935540fc817f_xi4jiy_w" returned: 0 in 0.557s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c209ee8f-5e98-4ada-a9d3-935540fc817f_xi4jiy_w {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:38 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Created reservations ['30088df8-2f27-4a79-bc47-f31ca6d8f22f', 'b3859db9-d7bb-4bf3-9c90-4f48c25341b9', 'eb1c8044-6b7f-4d03-abee-f4d3978cfcab', '8cbc6e8d-283d-4565-8902-9394c9b0455c'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:47:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c209ee8f-5e98-4ada-a9d3-935540fc817f_xi4jiy_w" returned: 1 in 0.505s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c209ee8f-5e98-4ada-a9d3-935540fc817f_xi4jiy_w' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:47:38 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b063de7-4eaf-49ac-bf09-0e119eeda27f]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.123s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:38 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:47:38 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Deleted volume successfully.
Sep 10 19:47:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD" returned: 0 in 0.527s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3fbfc75d-dc21-4696-9938-cddeaf642877 tempest-AttachVolumeTestJSON-16455690 None] Lock "cinder-93d54b4e-bb1f-4099-8d20-8c91d4317a59-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "cinder-0b2248a5-df62-42db-9f2b-8b8cef17578e-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Lock "cinder-0b2248a5-df62-42db-9f2b-8b8cef17578e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD" returned: 1 in 0.608s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:47:39 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] c209ee8f-5e98-4ada-a9d3-935540fc817f was raw, converting to raw {{(pid=82850) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 19:47:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:39 devstack quobyte-client[82855]: System call of process 96222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:47:39 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=107, name=volume-cff14768-30b1-4b41-9984-ebc339acdff3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:47:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3" returned: 0 in 0.301s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:39 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "cinder-quobyte-0b2248a5-df62-42db-9f2b-8b8cef17578e" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:39 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c209ee8f-5e98-4ada-a9d3-935540fc817f_gtikayxadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:47:39 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Converted 0.00 MB image at 0.00 MB/s
Sep 10 19:47:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3 1G" returned: 0 in 0.170s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Lock "cinder-quobyte-0b2248a5-df62-42db-9f2b-8b8cef17578e" acquired by "delete_volume" :: waited 0.252s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:40 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[058d4893-86d6-4bda-ba63-d80d92598348]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:40 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82d65e2-f676-457c-9092-36f66ae82a12]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0b2248a5-df62-42db-9f2b-8b8cef17578e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3" returned: 0 in 0.446s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0b2248a5-df62-42db-9f2b-8b8cef17578e" returned: 0 in 0.554s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0b2248a5-df62-42db-9f2b-8b8cef17578e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0b2248a5-df62-42db-9f2b-8b8cef17578e" returned: 0 in 0.100s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Lock "cinder-quobyte-0b2248a5-df62-42db-9f2b-8b8cef17578e" released by "delete_volume" :: held 0.930s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:41 devstack quobyte-client[82855]: System call of process 96232 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3" returned: 1 in 0.581s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Downloaded image c209ee8f-5e98-4ada-a9d3-935540fc817f ((None, None)) to volume cff14768-30b1-4b41-9984-ebc339acdff3 successfully. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Temporary image c209ee8f-5e98-4ada-a9d3-935540fc817f for user f363fbe053d348a0a61b0366b0fe91c0 is deleted. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Marking volume cff14768-30b1-4b41-9984-ebc339acdff3 as bootable. {{(pid=82850) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Copying metadata from image c209ee8f-5e98-4ada-a9d3-935540fc817f to cff14768-30b1-4b41-9984-ebc339acdff3. {{(pid=82850) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Creating volume glance metadata for volume cff14768-30b1-4b41-9984-ebc339acdff3 backed by image c209ee8f-5e98-4ada-a9d3-935540fc817f with: {'image_id': 'c209ee8f-5e98-4ada-a9d3-935540fc817f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '32fad6dc045e1067e0c7b1b920f242fe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82850) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Created reservations ['7c79ed50-a1ea-4af4-b4fa-1cbcff6506e9', 'c009a505-20d2-4d4e-9efa-3de134fcf7ed', 'f6963591-9ca6-463e-9b4b-af89519cf02f', '0f840b44-b600-4633-a802-0ab7082e358d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0f5fdf-3a5a-41c2-9217-d21ceccd5d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff14768-30b1-4b41-9984-ebc339acdff3', 'volume_size': 1, 'image_id': 'c209ee8f-5e98-4ada-a9d3-935540fc817f', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '32fad6dc045e1067e0c7b1b920f242fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c9ef070177440fb92cae178a5f84109', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '08965b6d503d16003364f4e3bdda47c16a1e9d12f485ed4784e71af91d3e4f182176cf096c665cc96229cf6328db3abbaaab45fdaeda79fdb2ae8b9215e533a9', 'id': 'c209ee8f-5e98-4ada-a9d3-935540fc817f', 'created_at': datetime.datetime(2025, 9, 10, 17, 47, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c209ee8f-5e98-4ada-a9d3-935540fc817f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc56e6b8be0>}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8d575e-2f01-42b3-9ffc-4b239ad3d317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:41 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Volume volume-cff14768-30b1-4b41-9984-ebc339acdff3 (cff14768-30b1-4b41-9984-ebc339acdff3): created successfully
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8d575e-2f01-42b3-9ffc-4b239ad3d317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Flow 'volume_create_manager' (eb286c99-02f7-4eb8-9704-f9f5079931e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:41 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5494228e-cfeb-49fb-b111-9a349d0705af tempest-VolumeImageDependencyTests-865024738 None] Created volume successfully.
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.268s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:47:41 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Deleted volume successfully.
Sep 10 19:47:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-45419ae6-c75a-40d3-9652-3eb52c938c13 tempest-AttachVolumeTestJSON-16455690 None] Lock "cinder-0b2248a5-df62-42db-9f2b-8b8cef17578e-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Acquiring lock "cinder-cff14768-30b1-4b41-9984-ebc339acdff3-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Lock "cinder-cff14768-30b1-4b41-9984-ebc339acdff3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:42 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Acquiring lock "cinder-quobyte-cff14768-30b1-4b41-9984-ebc339acdff3" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Lock "cinder-quobyte-cff14768-30b1-4b41-9984-ebc339acdff3" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:42 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[847502dd-cc47-40c0-9f4b-debc975b8a54]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3" returned: 0 in 0.460s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:43 devstack quobyte-client[82855]: System call of process 96241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:47:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3" returned: 1 in 0.450s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:47:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cff14768-30b1-4b41-9984-ebc339acdff3" returned: 0 in 0.129s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Lock "cinder-quobyte-cff14768-30b1-4b41-9984-ebc339acdff3" released by "delete_volume" :: held 1.269s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:44 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=68,cinder:UPDATE=91,cinder:DELETE=9,cinder:INSERT=26 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:47:44 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=68,cinder:UPDATE=99,cinder:DELETE=8,cinder:INSERT=23 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:47:44 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Created reservations ['14f4d29d-26b1-4a6b-b2b7-6c3e373fdbd5', '45c4fcda-76c1-4f9c-91e9-6a0d0c2607ea', '20908e8b-aa2f-456c-a3e3-e1696f3608f4', 'ddb36575-60eb-46ee-89af-2b2337086461'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:47:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.253s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:45 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:47:45 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Deleted volume successfully.
Sep 10 19:47:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3c033664-f2b0-4673-94c3-62e71eadb4ad tempest-VolumeImageDependencyTests-865024738 None] Lock "cinder-cff14768-30b1-4b41-9984-ebc339acdff3-delete_volume" released by "delete_volume" :: held 3.206s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:52 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Flow 'volume_create_manager' (685ac21a-d37a-415a-8d1a-e394ba09d837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2be1e2-f161-408c-a3cb-63e20a885863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2be1e2-f161-408c-a3cb-63e20a885863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-906576846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd3505b-1543-4a5a-b0fb-6989de2fe14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d1c9e31baa04a0aaf76fdb202e87d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:47:52Z,use_quota=True,user_id='3a6e10dc6b6c463c82ce453e71ec2d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929873ad-8201-4491-b5a9-a75512678cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929873ad-8201-4491-b5a9-a75512678cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd01c7ae-ea26-4476-b9e9-ed286d37b425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd01c7ae-ea26-4476-b9e9-ed286d37b425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdd3505b-1543-4a5a-b0fb-6989de2fe14a', 'volume_name': 'volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0cb461-5007-468d-97ed-e0ff64cf993a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0cb461-5007-468d-97ed-e0ff64cf993a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4a3144-74b9-4b9e-8687-90c43c9f1b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:52 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Volume cdd3505b-1543-4a5a-b0fb-6989de2fe14a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a', 'volume_size': 1}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-906576846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd3505b-1543-4a5a-b0fb-6989de2fe14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d1c9e31baa04a0aaf76fdb202e87d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:47:52Z,use_quota=True,user_id='3a6e10dc6b6c463c82ce453e71ec2d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Creating volume cdd3505b-1543-4a5a-b0fb-6989de2fe14a {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:47:52 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:52 devstack quobyte-client[82855]: System call of process 96252 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:47:52 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=108, name=volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a 1073741824" returned: 0 in 0.372s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a" returned: 0 in 0.111s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] <== create_volume: return (548ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:47:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.560s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4a3144-74b9-4b9e-8687-90c43c9f1b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581ce603-e461-44ad-86c9-f8851426a43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:53 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Volume volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a (cdd3505b-1543-4a5a-b0fb-6989de2fe14a): created successfully
Sep 10 19:47:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581ce603-e461-44ad-86c9-f8851426a43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Flow 'volume_create_manager' (685ac21a-d37a-415a-8d1a-e394ba09d837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:47:53 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-381f8134-b07b-4d57-a353-0e08a1ec8ef2 req-ad499cc4-c38e-4092-83a3-cd8748479da5 tempest-VolumesSnapshotsTestJSON-171344057 None] Created volume successfully.
Sep 10 19:47:54 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] Creating offline snapshot c1c798b2-b826-487b-8fd7-28bf4eea6df8 of volume cdd3505b-1543-4a5a-b0fb-6989de2fe14a {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:47:54 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c0d627-07e8-4ede-b7c1-907044fca50a]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a" returned: 0 in 0.405s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:55 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=109, name=volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:47:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8 1G" returned: 0 in 0.222s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): qemu-img rebase -u -b volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "qemu-img rebase -u -b volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8" returned: 0 in 0.145s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:47:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8" returned: 0 in 0.078s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:47:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8" returned: 0 in 0.114s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.info" returned: 0 in 0.091s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:47:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.info" returned: 0 in 0.079s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.435s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:56 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-ca16f3f3-56dd-4365-a7a1-967f9c173774 req-1a195f96-bda5-41d9-941a-2c2ca831e3e3 tempest-VolumesSnapshotsTestJSON-171344057 None] Create snapshot completed successfully
Sep 10 19:47:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Acquiring lock "cinder-c1c798b2-b826-487b-8fd7-28bf4eea6df8-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "cinder-c1c798b2-b826-487b-8fd7-28bf4eea6df8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:57 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Acquiring lock "cinder-quobyte-cdd3505b-1543-4a5a-b0fb-6989de2fe14a" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "cinder-quobyte-cdd3505b-1543-4a5a-b0fb-6989de2fe14a" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Acquiring lock "cinder-quobyte-c1c798b2-b826-487b-8fd7-28bf4eea6df8" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "cinder-quobyte-c1c798b2-b826-487b-8fd7-28bf4eea6df8" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Deleting offline snapshot c1c798b2-b826-487b-8fd7-28bf4eea6df8 of volume cdd3505b-1543-4a5a-b0fb-6989de2fe14a {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:47:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] snapshot_file for this snap is: volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:47:57 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[85502ad7-4a65-45cb-9742-cc23e27eda78]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8" returned: 0 in 0.399s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:47:57 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[749cb800-4486-4a08-8ea6-a0689377b9ae]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a" returned: 0 in 0.389s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8" returned: 0 in 0.211s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a.c1c798b2-b826-487b-8fd7-28bf4eea6df8" returned: 0 in 0.083s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "cinder-quobyte-c1c798b2-b826-487b-8fd7-28bf4eea6df8" released by "_delete_snapshot" :: held 1.352s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "cinder-quobyte-cdd3505b-1543-4a5a-b0fb-6989de2fe14a" released by "delete_snapshot" :: held 1.376s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:58 devstack cinder-volume[82850]: DEBUG cinder.quota [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Created reservations ['07ac7fe2-0cfd-410b-a0ff-d33774789ad6', 'd92f10a2-28dc-48a5-b639-e7a34645e24b', 'bce62e74-8b96-468c-bc31-9f71fe3096be', '43568e52-714c-4479-a22c-0c655d90befd'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:47:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Delete snapshot completed successfully.
Sep 10 19:47:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-a20556e6-0232-4b33-bfcc-16acb2cd9af8 req-f6c91257-c03c-4357-b587-92ea4fa6ce12 tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "cinder-c1c798b2-b826-487b-8fd7-28bf4eea6df8-delete_snapshot" released by "delete_snapshot" :: held 1.773s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Acquiring lock "cinder-cdd3505b-1543-4a5a-b0fb-6989de2fe14a-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "cinder-cdd3505b-1543-4a5a-b0fb-6989de2fe14a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:59 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Acquiring lock "cinder-quobyte-cdd3505b-1543-4a5a-b0fb-6989de2fe14a" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "cinder-quobyte-cdd3505b-1543-4a5a-b0fb-6989de2fe14a" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e236483-59a0-4d2d-aed1-8f81bdf00dd3]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a" returned: 0 in 0.408s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cdd3505b-1543-4a5a-b0fb-6989de2fe14a" returned: 0 in 0.101s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "cinder-quobyte-cdd3505b-1543-4a5a-b0fb-6989de2fe14a" released by "delete_volume" :: held 0.660s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:48:00 devstack cinder-volume[82850]: DEBUG cinder.quota [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Created reservations ['da0931a2-fbe6-447d-932c-99508fa87210', '7f1ab4b2-4c79-4e4a-9f78-ede452c8ca3e', '017f6e71-e0d6-4c55-9f77-db4b70c58753', '1b323dda-afce-4159-8520-14d441b7feaa'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:48:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:48:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:48:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.082s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:00 devstack cinder-volume[82850]: DEBUG cinder.manager [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:48:00 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Deleted volume successfully.
Sep 10 19:48:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-8602cb8c-86a3-47ad-ac64-ee805f80b8a8 req-ba7629b3-3eb3-44b3-9339-8ee7e4eafefc tempest-VolumesSnapshotsTestJSON-171344057 None] Lock "cinder-cdd3505b-1543-4a5a-b0fb-6989de2fe14a-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:48:04 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Flow 'volume_create_manager' (3e546f72-0861-478f-a31b-194698d5ff1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280f0876-e4b5-43ec-9e6b-d719cae749fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280f0876-e4b5-43ec-9e6b-d719cae749fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1664461269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a89de7-db1d-45a8-9e53-08532c585d63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3255f1fba263402d9eccf88833c1f859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:48:05Z,use_quota=True,user_id='42b152ed8f3043d2b2d9c28fdac1cdc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5744a9f1-806a-4437-a32c-6747fd63f5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5744a9f1-806a-4437-a32c-6747fd63f5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba84711-5aa7-489d-b1b8-99305ff78b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba84711-5aa7-489d-b1b8-99305ff78b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a89de7-db1d-45a8-9e53-08532c585d63', 'volume_name': 'volume-52a89de7-db1d-45a8-9e53-08532c585d63', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819b3c89-5fc8-4d9a-999a-c0adca18dbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819b3c89-5fc8-4d9a-999a-c0adca18dbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4eb4c9-f863-4560-a64f-54ec823c8199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:05 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Volume 52a89de7-db1d-45a8-9e53-08532c585d63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a89de7-db1d-45a8-9e53-08532c585d63', 'volume_size': 1}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1664461269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a89de7-db1d-45a8-9e53-08532c585d63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3255f1fba263402d9eccf88833c1f859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:48:05Z,use_quota=True,user_id='42b152ed8f3043d2b2d9c28fdac1cdc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Creating volume 52a89de7-db1d-45a8-9e53-08532c585d63 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:48:05 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-52a89de7-db1d-45a8-9e53-08532c585d63 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:05 devstack quobyte-client[82855]: System call of process 96286 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:48:05 devstack quobyte-client[82855]: System call of process 96286 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:48:05 devstack quobyte-client[82855]: System call of process 96286 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:48:05 devstack quobyte-client[82855]: System call of process 96286 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:48:05 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=111, name=volume-52a89de7-db1d-45a8-9e53-08532c585d63, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-52a89de7-db1d-45a8-9e53-08532c585d63 1073741824" returned: 0 in 0.370s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-52a89de7-db1d-45a8-9e53-08532c585d63 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-52a89de7-db1d-45a8-9e53-08532c585d63" returned: 0 in 0.117s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] <== create_volume: return (541ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.553s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4eb4c9-f863-4560-a64f-54ec823c8199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a89de7-db1d-45a8-9e53-08532c585d63', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd01069-b8a4-4da2-80c1-3a440bcea679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:05 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Volume volume-52a89de7-db1d-45a8-9e53-08532c585d63 (52a89de7-db1d-45a8-9e53-08532c585d63): created successfully
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd01069-b8a4-4da2-80c1-3a440bcea679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Flow 'volume_create_manager' (3e546f72-0861-478f-a31b-194698d5ff1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:48:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-557a3617-9ebb-4737-bf13-286cf31fc0e6 tempest-VolumesTestJSON-1832788328 None] Created volume successfully.
Sep 10 19:48:07 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Flow 'volume_create_manager' (55ecd7da-7193-418f-bab4-9060fcca0981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148915fb-b023-4eb3-8376-649a4cb8152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148915fb-b023-4eb3-8376-649a4cb8152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-437135872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98a7c842-887b-4e37-91de-f095240042e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3255f1fba263402d9eccf88833c1f859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:48:07Z,use_quota=True,user_id='42b152ed8f3043d2b2d9c28fdac1cdc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717764ff-7444-463b-b754-3b10e44cf185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717764ff-7444-463b-b754-3b10e44cf185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8348c37c-71ea-4732-b512-af262dbe2eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8348c37c-71ea-4732-b512-af262dbe2eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98a7c842-887b-4e37-91de-f095240042e7', 'volume_name': 'volume-98a7c842-887b-4e37-91de-f095240042e7', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a5faa2-8ee0-4ff4-897c-11c709c1dfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a5faa2-8ee0-4ff4-897c-11c709c1dfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f9df3e-0b37-4e5d-97aa-ea2ee40db42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:07 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Volume 98a7c842-887b-4e37-91de-f095240042e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98a7c842-887b-4e37-91de-f095240042e7', 'volume_size': 1}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-437135872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98a7c842-887b-4e37-91de-f095240042e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3255f1fba263402d9eccf88833c1f859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:48:07Z,use_quota=True,user_id='42b152ed8f3043d2b2d9c28fdac1cdc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Creating volume 98a7c842-887b-4e37-91de-f095240042e7 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:48:07 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:48:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-98a7c842-887b-4e37-91de-f095240042e7 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:07 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=112, name=volume-98a7c842-887b-4e37-91de-f095240042e7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:48:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-98a7c842-887b-4e37-91de-f095240042e7 1073741824" returned: 0 in 0.330s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-98a7c842-887b-4e37-91de-f095240042e7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-98a7c842-887b-4e37-91de-f095240042e7" returned: 0 in 0.087s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] <== create_volume: return (483ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:48:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.494s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f9df3e-0b37-4e5d-97aa-ea2ee40db42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98a7c842-887b-4e37-91de-f095240042e7', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce3947c-985c-4adf-8a29-0aacc27afdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:08 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Volume volume-98a7c842-887b-4e37-91de-f095240042e7 (98a7c842-887b-4e37-91de-f095240042e7): created successfully
Sep 10 19:48:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce3947c-985c-4adf-8a29-0aacc27afdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Flow 'volume_create_manager' (55ecd7da-7193-418f-bab4-9060fcca0981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:48:08 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-da3d3a8d-cb54-4a8d-8dc0-1c83f0d5f5d8 tempest-VolumesTestJSON-1832788328 None] Created volume successfully.
Sep 10 19:48:09 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Flow 'volume_create_manager' (52ffa2a8-fa37-4dac-a219-d179cba17188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20718068-c86d-4a19-8935-1cffe80f4477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20718068-c86d-4a19-8935-1cffe80f4477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-243937374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478f7c6b-9602-4c9f-b4ad-75e452bf9b98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3255f1fba263402d9eccf88833c1f859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:48:09Z,use_quota=True,user_id='42b152ed8f3043d2b2d9c28fdac1cdc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0589057f-10a2-4870-9406-802b06d13998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0589057f-10a2-4870-9406-802b06d13998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fac374-35a5-4bf0-95fc-33fc7ae4ed71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fac374-35a5-4bf0-95fc-33fc7ae4ed71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '478f7c6b-9602-4c9f-b4ad-75e452bf9b98', 'volume_name': 'volume-478f7c6b-9602-4c9f-b4ad-75e452bf9b98', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f370e02c-03ce-41a2-bc53-06ad3374d07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f370e02c-03ce-41a2-bc53-06ad3374d07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da95cca-7f4e-4dbf-b3f6-764aa657e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:09 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Volume 478f7c6b-9602-4c9f-b4ad-75e452bf9b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-478f7c6b-9602-4c9f-b4ad-75e452bf9b98', 'volume_size': 1}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-243937374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478f7c6b-9602-4c9f-b4ad-75e452bf9b98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3255f1fba263402d9eccf88833c1f859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:48:09Z,use_quota=True,user_id='42b152ed8f3043d2b2d9c28fdac1cdc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Creating volume 478f7c6b-9602-4c9f-b4ad-75e452bf9b98 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:48:09 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-478f7c6b-9602-4c9f-b4ad-75e452bf9b98 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:09 devstack quobyte-client[82855]: System call of process 96304 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:48:09 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=113, name=volume-478f7c6b-9602-4c9f-b4ad-75e452bf9b98, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-478f7c6b-9602-4c9f-b4ad-75e452bf9b98 1073741824" returned: 0 in 0.437s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-478f7c6b-9602-4c9f-b4ad-75e452bf9b98 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-478f7c6b-9602-4c9f-b4ad-75e452bf9b98" returned: 0 in 0.214s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] <== create_volume: return (744ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:48:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da95cca-7f4e-4dbf-b3f6-764aa657e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-478f7c6b-9602-4c9f-b4ad-75e452bf9b98', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a1e46c-30ef-4d20-bc5b-0f089651f896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:10 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Volume volume-478f7c6b-9602-4c9f-b4ad-75e452bf9b98 (478f7c6b-9602-4c9f-b4ad-75e452bf9b98): created successfully
Sep 10 19:48:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a1e46c-30ef-4d20-bc5b-0f089651f896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Flow 'volume_create_manager' (52ffa2a8-fa37-4dac-a219-d179cba17188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:48:10 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-db13989b-6d83-452c-a0c6-1826aed08123 tempest-VolumesTestJSON-1832788328 None] Created volume successfully.
Sep 10 19:48:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Acquiring lock "cinder-478f7c6b-9602-4c9f-b4ad-75e452bf9b98-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:48:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Lock "cinder-478f7c6b-9602-4c9f-b4ad-75e452bf9b98-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:48:12 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:48:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Acquiring lock "cinder-quobyte-478f7c6b-9602-4c9f-b4ad-75e452bf9b98" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:48:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Lock "cinder-quobyte-478f7c6b-9602-4c9f-b4ad-75e452bf9b98" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:48:12 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[41799418-f37e-449c-b1b3-2bccc03cf3f1]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:48:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-478f7c6b-9602-4c9f-b4ad-75e452bf9b98 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-478f7c6b-9602-4c9f-b4ad-75e452bf9b98" returned: 0 in 0.386s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-478f7c6b-9602-4c9f-b4ad-75e452bf9b98 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-478f7c6b-9602-4c9f-b4ad-75e452bf9b98" returned: 0 in 0.109s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Lock "cinder-quobyte-478f7c6b-9602-4c9f-b4ad-75e452bf9b98" released by "delete_volume" :: held 0.641s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:48:13 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Created reservations ['3e085d36-bcdd-423f-9efb-c0624e68552c', '6fb694b5-0b53-4e20-9329-4628ae8daae2', '2a1f2435-6b0b-475a-a6bb-0c460939c475', '3c363b23-ae9b-41b4-b5b3-4895510ec154'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:48:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:48:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:48:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.111s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:13 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:48:13 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Deleted volume successfully.
Sep 10 19:48:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-57178033-f7c4-4507-b9c0-ae0813eff976 tempest-VolumesTestJSON-1832788328 None] Lock "cinder-478f7c6b-9602-4c9f-b4ad-75e452bf9b98-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:48:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:48:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:48:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:48:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.115s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:48:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Acquiring lock "cinder-98a7c842-887b-4e37-91de-f095240042e7-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:48:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Lock "cinder-98a7c842-887b-4e37-91de-f095240042e7-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:48:14 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:48:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Acquiring lock "cinder-quobyte-98a7c842-887b-4e37-91de-f095240042e7" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:48:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Lock "cinder-quobyte-98a7c842-887b-4e37-91de-f095240042e7" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:48:14 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[339c9e02-a4ae-4eb1-a7cd-0574cc73b82f]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:48:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-98a7c842-887b-4e37-91de-f095240042e7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-98a7c842-887b-4e37-91de-f095240042e7" returned: 0 in 0.373s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-98a7c842-887b-4e37-91de-f095240042e7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-98a7c842-887b-4e37-91de-f095240042e7" returned: 0 in 0.083s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Lock "cinder-quobyte-98a7c842-887b-4e37-91de-f095240042e7" released by "delete_volume" :: held 0.594s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:48:15 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Created reservations ['cdaad88b-9ffc-4395-9efe-9769d5796a4e', '68dc8f1d-2d7a-45b5-aae2-13c38379ff59', 'ab864b70-0f12-4791-94af-048fedccb534', '0b9868eb-f69a-48aa-91bd-f12458754f5c'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:48:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:48:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:48:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.087s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:16 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:48:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Deleted volume successfully.
Sep 10 19:48:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d70abf94-6ae0-4b01-86c1-2cebe25196a3 tempest-VolumesTestJSON-1832788328 None] Lock "cinder-98a7c842-887b-4e37-91de-f095240042e7-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:48:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Acquiring lock "cinder-52a89de7-db1d-45a8-9e53-08532c585d63-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:48:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Lock "cinder-52a89de7-db1d-45a8-9e53-08532c585d63-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:48:17 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:48:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Acquiring lock "cinder-quobyte-52a89de7-db1d-45a8-9e53-08532c585d63" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:48:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Lock "cinder-quobyte-52a89de7-db1d-45a8-9e53-08532c585d63" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:48:17 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e401c606-49b5-4056-b677-07355ab28a15]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:48:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-52a89de7-db1d-45a8-9e53-08532c585d63 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-52a89de7-db1d-45a8-9e53-08532c585d63" returned: 0 in 0.612s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-52a89de7-db1d-45a8-9e53-08532c585d63 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-52a89de7-db1d-45a8-9e53-08532c585d63" returned: 0 in 0.088s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Lock "cinder-quobyte-52a89de7-db1d-45a8-9e53-08532c585d63" released by "delete_volume" :: held 0.861s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:48:18 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Created reservations ['66820646-7edc-4656-8043-b3f1db02e957', '28830fc1-2e9c-4b42-9aeb-454f68dba56a', 'bb9f8ac4-2706-4561-8a0f-ca2427309f1c', '4c659ea5-903a-440e-a505-37e998bd56ac'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:48:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:48:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:48:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.089s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:18 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:48:18 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Deleted volume successfully.
Sep 10 19:48:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ce8eec86-c4a2-454a-a8ae-27ce90cdc73b tempest-VolumesTestJSON-1832788328 None] Lock "cinder-52a89de7-db1d-45a8-9e53-08532c585d63-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:48:28 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:DELETE=2,cinder:SELECT=34,cinder:UPDATE=45,cinder:INSERT=10 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:48:28 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=32,cinder:INSERT=14,cinder:UPDATE=63,cinder:DELETE=8 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:48:42 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Flow 'volume_create_manager' (13b42f52-89ee-4c37-8ddf-e4db37ac73b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd24379-9277-4102-bd0f-b02a178faceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd24379-9277-4102-bd0f-b02a178faceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-884244778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130e2285-360e-4333-bb77-6df60c49997a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8d710f07484de3bed89e9b305e1ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:48:42Z,use_quota=True,user_id='95a3da68010a4126a76cad655743df10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69d70aa1-2c08-4527-8fca-7304952ff49f),volume_type_id=69d70aa1-2c08-4527-8fca-7304952ff49f)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f068c9-6da1-4133-8366-7c1f59401510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f068c9-6da1-4133-8366-7c1f59401510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24adbe7e-3ba2-42ee-925e-e17ee448be5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24adbe7e-3ba2-42ee-925e-e17ee448be5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '130e2285-360e-4333-bb77-6df60c49997a', 'volume_name': 'volume-130e2285-360e-4333-bb77-6df60c49997a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e631dc6c-39fc-46eb-a62e-52bb9f1f80f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e631dc6c-39fc-46eb-a62e-52bb9f1f80f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f95c839-61a3-4a6f-811c-9fd9babbbb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:42 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Volume 130e2285-360e-4333-bb77-6df60c49997a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-130e2285-360e-4333-bb77-6df60c49997a', 'volume_size': 1}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-884244778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130e2285-360e-4333-bb77-6df60c49997a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8d710f07484de3bed89e9b305e1ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:48:42Z,use_quota=True,user_id='95a3da68010a4126a76cad655743df10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69d70aa1-2c08-4527-8fca-7304952ff49f),volume_type_id=69d70aa1-2c08-4527-8fca-7304952ff49f)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Creating volume 130e2285-360e-4333-bb77-6df60c49997a {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:48:42 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-130e2285-360e-4333-bb77-6df60c49997a 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:42 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=114, name=volume-130e2285-360e-4333-bb77-6df60c49997a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-130e2285-360e-4333-bb77-6df60c49997a 1073741824" returned: 0 in 0.309s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-130e2285-360e-4333-bb77-6df60c49997a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-130e2285-360e-4333-bb77-6df60c49997a" returned: 0 in 0.087s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] <== create_volume: return (456ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:48:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.467s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f95c839-61a3-4a6f-811c-9fd9babbbb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-130e2285-360e-4333-bb77-6df60c49997a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22bcbb4-7ac3-45cc-bc12-e6e5f09cacff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:43 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Volume volume-130e2285-360e-4333-bb77-6df60c49997a (130e2285-360e-4333-bb77-6df60c49997a): created successfully
Sep 10 19:48:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22bcbb4-7ac3-45cc-bc12-e6e5f09cacff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Flow 'volume_create_manager' (13b42f52-89ee-4c37-8ddf-e4db37ac73b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:48:43 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-138b6b13-104f-4220-978e-265aa1e86dc9 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Created volume successfully.
Sep 10 19:48:43 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-f9484532-19c7-446a-9709-8d928db0151a tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:48:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f9484532-19c7-446a-9709-8d928db0151a tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f9484532-19c7-446a-9709-8d928db0151a tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f9484532-19c7-446a-9709-8d928db0151a tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:48:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f9484532-19c7-446a-9709-8d928db0151a tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:48:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f9484532-19c7-446a-9709-8d928db0151a tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f9484532-19c7-446a-9709-8d928db0151a tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f9484532-19c7-446a-9709-8d928db0151a tempest-VolumeRetypeWithoutMigrationTest-933020192 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.085s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:43 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-f9484532-19c7-446a-9709-8d928db0151a tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:48:43 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f9484532-19c7-446a-9709-8d928db0151a tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Retype volume completed successfully.
Sep 10 19:48:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Acquiring lock "cinder-130e2285-360e-4333-bb77-6df60c49997a-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:48:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Lock "cinder-130e2285-360e-4333-bb77-6df60c49997a-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:48:45 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:48:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Acquiring lock "cinder-quobyte-130e2285-360e-4333-bb77-6df60c49997a" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:48:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Lock "cinder-quobyte-130e2285-360e-4333-bb77-6df60c49997a" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:48:45 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dec5c57-15b4-4c05-951f-3590adefec5a]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:48:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-130e2285-360e-4333-bb77-6df60c49997a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-130e2285-360e-4333-bb77-6df60c49997a" returned: 0 in 0.376s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-130e2285-360e-4333-bb77-6df60c49997a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-130e2285-360e-4333-bb77-6df60c49997a" returned: 0 in 0.128s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Lock "cinder-quobyte-130e2285-360e-4333-bb77-6df60c49997a" released by "delete_volume" :: held 0.636s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:48:46 devstack cinder-volume[82850]: WARNING cinder.quota [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:48:46 devstack cinder-volume[82850]: WARNING cinder.quota [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:48:46 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Created reservations ['25521548-4e9c-4310-b5c4-ac773d423498', 'f3f619c0-8ec6-4e27-80fb-20b1b046d8f2', '9a038ef0-f515-4473-8fb9-9ed79b5c6627', 'cf6a4dc6-3b32-461d-9fa6-3a552ec98b56'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:48:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:48:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:48:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.097s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:46 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:48:46 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Deleted volume successfully.
Sep 10 19:48:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ecac2854-0e05-4ac8-92b2-5eebcaef4de8 tempest-VolumeRetypeWithoutMigrationTest-933020192 None] Lock "cinder-130e2285-360e-4333-bb77-6df60c49997a-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:48:53 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Flow 'volume_create_manager' (e9852d57-531a-4a95-8001-66f311d6bd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165e9287-aaf2-4079-8cf2-97573bbcb10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165e9287-aaf2-4079-8cf2-97573bbcb10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1125854019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d428c7-4ce3-4362-a64b-8b3353b800f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc8bfa6529e41aa885a2119f45c721f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:48:53Z,use_quota=True,user_id='33173b6a28b64386aa7d41b614c51ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(000e15ab-8be9-4fa7-9ef4-0d07828f1397),volume_type_id=000e15ab-8be9-4fa7-9ef4-0d07828f1397)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023dc6c2-74a6-4682-87f6-745a13db6b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023dc6c2-74a6-4682-87f6-745a13db6b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8dfebd7-8da1-4ee8-a3f0-6d2536504e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8dfebd7-8da1-4ee8-a3f0-6d2536504e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67d428c7-4ce3-4362-a64b-8b3353b800f7', 'volume_name': 'volume-67d428c7-4ce3-4362-a64b-8b3353b800f7', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce848168-8846-44a5-8c31-8e38cbbcdbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce848168-8846-44a5-8c31-8e38cbbcdbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47285295-e3fa-4f52-a191-a72c2cf3560a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:53 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Volume 67d428c7-4ce3-4362-a64b-8b3353b800f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67d428c7-4ce3-4362-a64b-8b3353b800f7', 'volume_size': 1}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1125854019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d428c7-4ce3-4362-a64b-8b3353b800f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc8bfa6529e41aa885a2119f45c721f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:48:53Z,use_quota=True,user_id='33173b6a28b64386aa7d41b614c51ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(000e15ab-8be9-4fa7-9ef4-0d07828f1397),volume_type_id=000e15ab-8be9-4fa7-9ef4-0d07828f1397)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Creating volume 67d428c7-4ce3-4362-a64b-8b3353b800f7 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:48:53 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-67d428c7-4ce3-4362-a64b-8b3353b800f7 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:53 devstack quobyte-client[82855]: System call of process 96372 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:48:53 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=115, name=volume-67d428c7-4ce3-4362-a64b-8b3353b800f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-67d428c7-4ce3-4362-a64b-8b3353b800f7 1073741824" returned: 0 in 0.319s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-67d428c7-4ce3-4362-a64b-8b3353b800f7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-67d428c7-4ce3-4362-a64b-8b3353b800f7" returned: 0 in 0.092s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] <== create_volume: return (470ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.481s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47285295-e3fa-4f52-a191-a72c2cf3560a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67d428c7-4ce3-4362-a64b-8b3353b800f7', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd1b005-8dd2-47f8-946e-f99de8394ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:53 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Volume volume-67d428c7-4ce3-4362-a64b-8b3353b800f7 (67d428c7-4ce3-4362-a64b-8b3353b800f7): created successfully
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd1b005-8dd2-47f8-946e-f99de8394ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Flow 'volume_create_manager' (e9852d57-531a-4a95-8001-66f311d6bd39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:48:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-02dbb78a-aacd-462a-8d08-d6a1595f0b27 tempest-VolumeTypesAccessTest-1206145188 None] Created volume successfully.
Sep 10 19:48:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Acquiring lock "cinder-67d428c7-4ce3-4362-a64b-8b3353b800f7-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:48:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Lock "cinder-67d428c7-4ce3-4362-a64b-8b3353b800f7-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:48:55 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:48:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Acquiring lock "cinder-quobyte-67d428c7-4ce3-4362-a64b-8b3353b800f7" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:48:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Lock "cinder-quobyte-67d428c7-4ce3-4362-a64b-8b3353b800f7" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:48:55 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed948c39-f9a6-4ecd-a72e-1d2f48586ac8]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:48:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-67d428c7-4ce3-4362-a64b-8b3353b800f7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-67d428c7-4ce3-4362-a64b-8b3353b800f7" returned: 0 in 0.378s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-67d428c7-4ce3-4362-a64b-8b3353b800f7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-67d428c7-4ce3-4362-a64b-8b3353b800f7" returned: 0 in 0.102s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Lock "cinder-quobyte-67d428c7-4ce3-4362-a64b-8b3353b800f7" released by "delete_volume" :: held 0.606s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:48:56 devstack cinder-volume[82850]: WARNING cinder.quota [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1254635122 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1254635122, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:48:56 devstack cinder-volume[82850]: WARNING cinder.quota [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1254635122 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1254635122, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:48:56 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Created reservations ['c06de452-9e85-4455-a30b-3c109b41bfb8', '0a08d30d-490f-4a17-925f-cd4bd4f17ba4', '2459e90f-870e-4380-9f59-566b7b73b6c8', '9800ef4d-700a-43d5-8d4d-cda4addf67c9'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:48:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:48:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:48:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.134s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:56 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:48:56 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Deleted volume successfully.
Sep 10 19:48:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-32847afd-b032-4606-bb9a-3372dd2520c7 tempest-VolumeTypesAccessTest-1206145188 None] Lock "cinder-67d428c7-4ce3-4362-a64b-8b3353b800f7-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:06 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=23,cinder:UPDATE=27,cinder:INSERT=6 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:49:06 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=22,cinder:SELECT=15,cinder:DELETE=4,cinder:INSERT=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:49:14 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Flow 'volume_create_manager' (ab44192a-73cc-4279-9d81-090f445304d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889df422-2505-4fb1-830c-ef55b4cafde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889df422-2505-4fb1-830c-ef55b4cafde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-562843133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb864879-a107-490a-be21-664fa8966914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a330ca5f54e9982cb789a9469619b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:49:14Z,use_quota=True,user_id='69e61fc05fb44569bf6f46af28204741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f28b617-4d8d-4f46-94d7-93890aed4a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f28b617-4d8d-4f46-94d7-93890aed4a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2457bf3-b049-4409-a630-5b5b1ac7a077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2457bf3-b049-4409-a630-5b5b1ac7a077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb864879-a107-490a-be21-664fa8966914', 'volume_name': 'volume-cb864879-a107-490a-be21-664fa8966914', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3478de1c-4e1e-4eba-800a-0e1be7c17d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3478de1c-4e1e-4eba-800a-0e1be7c17d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d833fcf-5ead-4530-8ae2-536aa5e53172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:14 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Volume cb864879-a107-490a-be21-664fa8966914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb864879-a107-490a-be21-664fa8966914', 'volume_size': 1}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-562843133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb864879-a107-490a-be21-664fa8966914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a330ca5f54e9982cb789a9469619b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:49:14Z,use_quota=True,user_id='69e61fc05fb44569bf6f46af28204741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Creating volume cb864879-a107-490a-be21-664fa8966914 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:49:14 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.374s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:49:14 devstack quobyte-client[82855]: System call of process 96416 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:49:14 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=116, name=volume-cb864879-a107-490a-be21-664fa8966914, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:49:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914 1073741824" returned: 0 in 0.352s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914" returned: 0 in 0.083s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] <== create_volume: return (493ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:49:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.514s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d833fcf-5ead-4530-8ae2-536aa5e53172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb864879-a107-490a-be21-664fa8966914', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7481bbef-c8e8-4a2d-a3d7-ea8c3f792fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:15 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Volume volume-cb864879-a107-490a-be21-664fa8966914 (cb864879-a107-490a-be21-664fa8966914): created successfully
Sep 10 19:49:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7481bbef-c8e8-4a2d-a3d7-ea8c3f792fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Flow 'volume_create_manager' (ab44192a-73cc-4279-9d81-090f445304d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:49:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b564c433-27ae-4ddf-8322-469ac84d01db tempest-VolumesDeleteCascade-111098653 None] Created volume successfully.
Sep 10 19:49:16 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] Creating offline snapshot 75784aab-5eb3-49bc-a920-f6b96662ac08 of volume cb864879-a107-490a-be21-664fa8966914 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:49:16 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4dbbf8-fa5c-4a66-8ed0-52896b8a42cc]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914" returned: 0 in 0.578s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:17 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=117, name=volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:49:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 1G" returned: 0 in 0.305s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): qemu-img rebase -u -b volume-cb864879-a107-490a-be21-664fa8966914 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] CMD "qemu-img rebase -u -b volume-cb864879-a107-490a-be21-664fa8966914 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08" returned: 0 in 0.140s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:49:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08" returned: 0 in 0.079s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:49:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08" returned: 0 in 0.078s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.info" returned: 0 in 0.093s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:49:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.info" returned: 0 in 0.082s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.694s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:18 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-75092642-dca5-4566-999b-a08b05f3554e tempest-VolumesDeleteCascade-111098653 None] Create snapshot completed successfully
Sep 10 19:49:19 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] Creating offline snapshot 22c6de00-f255-436c-9fd7-40492d5fe6a3 of volume cb864879-a107-490a-be21-664fa8966914 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:49:19 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4a5094-ccec-4ba1-8d4b-46ae191293eb]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08" returned: 0 in 0.383s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb864879-a107-490a-be21-664fa8966914(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:49:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:19 devstack quobyte-client[82855]: System call of process 96438 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:49:19 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=119, name=volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:49:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3 1G" returned: 0 in 0.291s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): qemu-img rebase -u -b volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:20 devstack quobyte-client[82855]: System call of process 96441 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:49:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] CMD "qemu-img rebase -u -b volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3" returned: 0 in 0.143s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:49:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3" returned: 0 in 0.079s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:49:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3" returned: 0 in 0.098s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.286s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:20 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f3ddc8c2-42d2-4ff7-b89d-9b28cc2b710a tempest-VolumesDeleteCascade-111098653 None] Create snapshot completed successfully
Sep 10 19:49:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-cb864879-a107-490a-be21-664fa8966914-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-cb864879-a107-490a-be21-664fa8966914-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:21 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Performing cascade delete. {{(pid=82850) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 10 19:49:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-22c6de00-f255-436c-9fd7-40492d5fe6a3-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-22c6de00-f255-436c-9fd7-40492d5fe6a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:21 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-quobyte-cb864879-a107-490a-be21-664fa8966914" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-cb864879-a107-490a-be21-664fa8966914" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-quobyte-22c6de00-f255-436c-9fd7-40492d5fe6a3" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-22c6de00-f255-436c-9fd7-40492d5fe6a3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Deleting offline snapshot 22c6de00-f255-436c-9fd7-40492d5fe6a3 of volume cb864879-a107-490a-be21-664fa8966914 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:49:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] snapshot_file for this snap is: volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:49:21 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7b41d9-3401-47ca-bdc6-fa2fdf4a4d04]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3" returned: 0 in 0.409s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb864879-a107-490a-be21-664fa8966914(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:49:22 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdea0d0-bfad-4bae-8e38-71b82430979f]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08" returned: 0 in 0.409s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb864879-a107-490a-be21-664fa8966914(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:49:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3" returned: 0 in 0.233s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.22c6de00-f255-436c-9fd7-40492d5fe6a3" returned: 0 in 0.082s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-22c6de00-f255-436c-9fd7-40492d5fe6a3" released by "_delete_snapshot" :: held 1.425s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-cb864879-a107-490a-be21-664fa8966914" released by "delete_snapshot" :: held 1.451s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Created reservations ['af98f17c-2d8b-4664-8c7e-bf7eb898d6ec', 'c7a14509-ac52-4335-9de6-5b3ad4e6a031', 'a7af960d-98cc-4482-81d3-06103f417bee', '526f7b19-42da-4709-a382-50bbc3d9b18f'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:49:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Delete snapshot completed successfully.
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-22c6de00-f255-436c-9fd7-40492d5fe6a3-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-75784aab-5eb3-49bc-a920-f6b96662ac08-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-75784aab-5eb3-49bc-a920-f6b96662ac08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:23 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-quobyte-cb864879-a107-490a-be21-664fa8966914" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-cb864879-a107-490a-be21-664fa8966914" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-quobyte-75784aab-5eb3-49bc-a920-f6b96662ac08" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-75784aab-5eb3-49bc-a920-f6b96662ac08" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Deleting offline snapshot 75784aab-5eb3-49bc-a920-f6b96662ac08 of volume cb864879-a107-490a-be21-664fa8966914 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] snapshot_file for this snap is: volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[457b9879-540b-4a29-ac6c-1a313e6ff622]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08" returned: 0 in 0.337s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb864879-a107-490a-be21-664fa8966914(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[333972b9-ee2a-4309-9784-8cb787efe1d0]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914" returned: 0 in 0.449s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:24 devstack quobyte-client[82855]: System call of process 96468 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:49:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08" returned: 0 in 0.208s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914.75784aab-5eb3-49bc-a920-f6b96662ac08" returned: 0 in 0.082s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-75784aab-5eb3-49bc-a920-f6b96662ac08" released by "_delete_snapshot" :: held 1.343s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-cb864879-a107-490a-be21-664fa8966914" released by "delete_snapshot" :: held 1.365s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:25 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Created reservations ['2f140e87-860c-4f9e-b934-d40b5f83116b', 'cf6458f6-048f-4de3-9a7f-eaa2b9cb322d', '9bcbf75a-3dfd-41df-a875-c818d4fd5e21', '23f02015-b502-4ed6-acd8-e4459e1f7d42'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:49:25 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Delete snapshot completed successfully.
Sep 10 19:49:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-75784aab-5eb3-49bc-a920-f6b96662ac08-delete_snapshot" released by "delete_snapshot" :: held 1.788s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Snapshots deleted, issuing volume delete {{(pid=82850) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 10 19:49:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-quobyte-cb864879-a107-490a-be21-664fa8966914" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-cb864879-a107-490a-be21-664fa8966914" acquired by "delete_volume" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:25 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c461ff-7b5b-4a92-9b8c-cad260093a7a]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914" returned: 0 in 0.377s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-cb864879-a107-490a-be21-664fa8966914" returned: 0 in 0.087s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-cb864879-a107-490a-be21-664fa8966914" released by "delete_volume" :: held 0.646s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:26 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Created reservations ['b1180e9b-530e-42a7-ba41-708096f8a5dd', '332583df-1462-4d94-9d3e-dc97ec1e7bf3', '9f9b9b44-a3e9-4e3e-a5f4-77a77c57f749', 'c675c426-93ad-42e0-bcee-bb1da613f999'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:49:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:49:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:49:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.077s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:26 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:49:26 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Deleted volume successfully.
Sep 10 19:49:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7feae5f7-d5f0-4a41-b347-8100455c9265 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-cb864879-a107-490a-be21-664fa8966914-delete_volume" released by "delete_volume" :: held 5.253s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:27 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Flow 'volume_create_manager' (6b55694d-7010-4445-bc93-01367009d53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0638c731-53cc-4c39-9b70-a17a84f03517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0638c731-53cc-4c39-9b70-a17a84f03517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-845485677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb22fc7-a040-4f6d-98f1-203b374bb832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a330ca5f54e9982cb789a9469619b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:49:27Z,use_quota=True,user_id='69e61fc05fb44569bf6f46af28204741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc669438-b688-4fde-9bbd-9a699d7e83b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc669438-b688-4fde-9bbd-9a699d7e83b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e02f07-be90-4b68-aee9-4a2bd5c8b83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e02f07-be90-4b68-aee9-4a2bd5c8b83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb22fc7-a040-4f6d-98f1-203b374bb832', 'volume_name': 'volume-ccb22fc7-a040-4f6d-98f1-203b374bb832', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795e0c2a-12d0-421f-8c94-1e14bbc29976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795e0c2a-12d0-421f-8c94-1e14bbc29976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a3a241-bd14-4570-ac33-af1090ad795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:27 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Volume ccb22fc7-a040-4f6d-98f1-203b374bb832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb22fc7-a040-4f6d-98f1-203b374bb832', 'volume_size': 1}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-845485677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb22fc7-a040-4f6d-98f1-203b374bb832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a330ca5f54e9982cb789a9469619b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:49:27Z,use_quota=True,user_id='69e61fc05fb44569bf6f46af28204741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Creating volume ccb22fc7-a040-4f6d-98f1-203b374bb832 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:49:27 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:27 devstack quobyte-client[82855]: System call of process 96477 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:49:27 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=120, name=volume-ccb22fc7-a040-4f6d-98f1-203b374bb832, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 1073741824" returned: 0 in 0.312s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832" returned: 0 in 0.077s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] <== create_volume: return (450ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:49:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.461s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a3a241-bd14-4570-ac33-af1090ad795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb22fc7-a040-4f6d-98f1-203b374bb832', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f678ef08-c048-4f24-8b03-66adb1318c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:28 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Volume volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 (ccb22fc7-a040-4f6d-98f1-203b374bb832): created successfully
Sep 10 19:49:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f678ef08-c048-4f24-8b03-66adb1318c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Flow 'volume_create_manager' (6b55694d-7010-4445-bc93-01367009d53c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:49:28 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-729ae31d-c284-4642-a576-c97ecc812121 tempest-VolumesDeleteCascade-111098653 None] Created volume successfully.
Sep 10 19:49:28 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] Creating offline snapshot 3bbe39bc-9974-45d0-82dd-6df077b954dd of volume ccb22fc7-a040-4f6d-98f1-203b374bb832 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:49:28 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b06a21-5700-4b41-88d8-3dfae8e445a3]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832" returned: 0 in 0.381s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:29 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=121, name=volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd 1G" returned: 0 in 0.228s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] CMD "qemu-img rebase -u -b volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd" returned: 0 in 0.116s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd" returned: 0 in 0.087s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd" returned: 0 in 0.082s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.info" returned: 0 in 0.084s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.info" returned: 0 in 0.075s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.398s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:30 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-318f53c4-b9d6-4f3f-8792-a58664919f22 tempest-VolumesDeleteCascade-111098653 None] Create snapshot completed successfully
Sep 10 19:49:31 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Flow 'volume_create_manager' (38aded1d-cdb6-4563-a00b-3e032160e49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2979a7a7-4ccd-4220-927a-ea6337e2c97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2979a7a7-4ccd-4220-927a-ea6337e2c97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-735724090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5834d8f9-477b-4264-9bd6-12e01435b29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892a330ca5f54e9982cb789a9469619b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3bbe39bc-9974-45d0-82dd-6df077b954dd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:49:31Z,use_quota=True,user_id='69e61fc05fb44569bf6f46af28204741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e68067-84ac-48c0-a2fd-f63825b89eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e68067-84ac-48c0-a2fd-f63825b89eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11fa48d3-8129-4944-92c1-51ab49c5d92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11fa48d3-8129-4944-92c1-51ab49c5d92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5834d8f9-477b-4264-9bd6-12e01435b29a', 'volume_name': 'volume-5834d8f9-477b-4264-9bd6-12e01435b29a', 'volume_size': 1, 'snapshot_id': '3bbe39bc-9974-45d0-82dd-6df077b954dd'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0aff02-2b04-4f41-9f2b-7b1e7f80d56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0aff02-2b04-4f41-9f2b-7b1e7f80d56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c918f441-5b43-4984-b6bf-392cc2f7f071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:31 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Volume 5834d8f9-477b-4264-9bd6-12e01435b29a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5834d8f9-477b-4264-9bd6-12e01435b29a', 'volume_size': 1, 'snapshot_id': '3bbe39bc-9974-45d0-82dd-6df077b954dd'}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-quobyte-3bbe39bc-9974-45d0-82dd-6df077b954dd-5834d8f9-477b-4264-9bd6-12e01435b29a" by "_create_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-3bbe39bc-9974-45d0-82dd-6df077b954dd-5834d8f9-477b-4264-9bd6-12e01435b29a" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Creating volume 5834d8f9-477b-4264-9bd6-12e01435b29a from snapshot 3bbe39bc-9974-45d0-82dd-6df077b954dd {{(pid=82850) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-quobyte-5834d8f9-477b-4264-9bd6-12e01435b29a" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-5834d8f9-477b-4264-9bd6-12e01435b29a" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] snapshot: 3bbe39bc-9974-45d0-82dd-6df077b954dd, volume: 5834d8f9-477b-4264-9bd6-12e01435b29a,  {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b8ca6d-408b-48f6-b46c-03c4068ada08]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd" returned: 0 in 0.385s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccb22fc7-a040-4f6d-98f1-203b374bb832(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6547a77-9a21-455c-b4ba-d1a75d863fb0]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832" returned: 0 in 0.385s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:32 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5834d8f9-477b-4264-9bd6-12e01435b29a not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 19:49:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5834d8f9-477b-4264-9bd6-12e01435b29a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:32 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=123, name=volume-5834d8f9-477b-4264-9bd6-12e01435b29a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:49:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5834d8f9-477b-4264-9bd6-12e01435b29a" returned: 0 in 5.987s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:38 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3e3145-479e-4daa-8445-d31c5ccacf74]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832" returned: 0 in 0.554s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:38 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Image conversion details: src /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5834d8f9-477b-4264-9bd6-12e01435b29a {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:49:38 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Converted 1024.00 MB image at 170.45 MB/s
Sep 10 19:49:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5834d8f9-477b-4264-9bd6-12e01435b29a is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:49:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5834d8f9-477b-4264-9bd6-12e01435b29a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5834d8f9-477b-4264-9bd6-12e01435b29a" returned: 0 in 0.083s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-5834d8f9-477b-4264-9bd6-12e01435b29a" released by "_copy_volume_from_snapshot" :: held 7.715s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-3bbe39bc-9974-45d0-82dd-6df077b954dd-5834d8f9-477b-4264-9bd6-12e01435b29a" released by "_create_volume_from_snapshot" :: held 7.746s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.764s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c918f441-5b43-4984-b6bf-392cc2f7f071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5834d8f9-477b-4264-9bd6-12e01435b29a', 'volume_size': 1, 'snapshot_id': '3bbe39bc-9974-45d0-82dd-6df077b954dd'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41abcdbf-6a30-4610-a80e-78c8bc6e99b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:39 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Volume volume-5834d8f9-477b-4264-9bd6-12e01435b29a (5834d8f9-477b-4264-9bd6-12e01435b29a): created successfully
Sep 10 19:49:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41abcdbf-6a30-4610-a80e-78c8bc6e99b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Flow 'volume_create_manager' (38aded1d-cdb6-4563-a00b-3e032160e49b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:49:39 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cb38fc39-402a-4236-abed-82ebae8d1068 tempest-VolumesDeleteCascade-111098653 None] Created volume successfully.
Sep 10 19:49:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-ccb22fc7-a040-4f6d-98f1-203b374bb832-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-ccb22fc7-a040-4f6d-98f1-203b374bb832-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:40 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Performing cascade delete. {{(pid=82850) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 10 19:49:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-3bbe39bc-9974-45d0-82dd-6df077b954dd-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-3bbe39bc-9974-45d0-82dd-6df077b954dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:40 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-quobyte-ccb22fc7-a040-4f6d-98f1-203b374bb832" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-ccb22fc7-a040-4f6d-98f1-203b374bb832" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-quobyte-3bbe39bc-9974-45d0-82dd-6df077b954dd" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-3bbe39bc-9974-45d0-82dd-6df077b954dd" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Deleting offline snapshot 3bbe39bc-9974-45d0-82dd-6df077b954dd of volume ccb22fc7-a040-4f6d-98f1-203b374bb832 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:49:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] snapshot_file for this snap is: volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:49:40 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f9f975-5b8c-4939-a4d5-e69b4e95fba9]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd" returned: 0 in 0.394s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccb22fc7-a040-4f6d-98f1-203b374bb832(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:49:41 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b6e16d-c080-44e1-986f-0db234014ad9]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832" returned: 0 in 0.368s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd" returned: 0 in 0.202s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832.3bbe39bc-9974-45d0-82dd-6df077b954dd" returned: 0 in 0.081s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-3bbe39bc-9974-45d0-82dd-6df077b954dd" released by "_delete_snapshot" :: held 1.330s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-ccb22fc7-a040-4f6d-98f1-203b374bb832" released by "delete_snapshot" :: held 1.352s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:42 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Created reservations ['56ad3b68-3a09-4dac-bf03-d9e9357062ae', '02ea53cf-ec82-4e3c-aa29-66a26b3ae439', 'a001ba3d-697e-41c2-be4c-6bb91c3540d9', 'e9b4a171-c3ee-4a41-b81c-dbdee352a1b0'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:49:42 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Delete snapshot completed successfully.
Sep 10 19:49:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-3bbe39bc-9974-45d0-82dd-6df077b954dd-delete_snapshot" released by "delete_snapshot" :: held 1.815s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Snapshots deleted, issuing volume delete {{(pid=82850) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 10 19:49:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-quobyte-ccb22fc7-a040-4f6d-98f1-203b374bb832" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-ccb22fc7-a040-4f6d-98f1-203b374bb832" acquired by "delete_volume" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:42 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f293e8a-7ce6-419e-91f0-091505b49900]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832" returned: 0 in 0.398s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ccb22fc7-a040-4f6d-98f1-203b374bb832" returned: 0 in 0.090s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-ccb22fc7-a040-4f6d-98f1-203b374bb832" released by "delete_volume" :: held 0.641s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:43 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Created reservations ['def07423-cf26-4507-93cc-45f8d9276efb', 'e317497d-ba3f-48b9-8599-375b1c3a91d3', '0af55b7b-3559-4a04-8218-3529c646840b', '67932848-2253-4dcf-8800-7b9cbed2b2d0'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:49:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:49:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:49:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.080s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:43 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:49:43 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Deleted volume successfully.
Sep 10 19:49:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-25d12a93-c250-4ec2-912a-2c4b7797b542 tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-ccb22fc7-a040-4f6d-98f1-203b374bb832-delete_volume" released by "delete_volume" :: held 3.403s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-5834d8f9-477b-4264-9bd6-12e01435b29a-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-5834d8f9-477b-4264-9bd6-12e01435b29a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:44 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "cinder-quobyte-5834d8f9-477b-4264-9bd6-12e01435b29a" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-5834d8f9-477b-4264-9bd6-12e01435b29a" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:44 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[caba2e97-611c-4642-ba7b-1ac0b7502fbf]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5834d8f9-477b-4264-9bd6-12e01435b29a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5834d8f9-477b-4264-9bd6-12e01435b29a" returned: 0 in 0.372s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5834d8f9-477b-4264-9bd6-12e01435b29a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-5834d8f9-477b-4264-9bd6-12e01435b29a" returned: 0 in 0.119s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-quobyte-5834d8f9-477b-4264-9bd6-12e01435b29a" released by "delete_volume" :: held 0.638s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:45 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Created reservations ['0858fb4f-28e1-4fd4-bcf8-bf6c4af417a0', 'b6748212-dc59-4700-b10e-69d7939c8d57', '3688a7aa-ce45-47e6-b107-d3f7584f148a', 'd69b1943-ab65-4e43-b4f0-bbf4d0539831'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:49:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:49:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:49:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.103s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:45 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:49:45 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Deleted volume successfully.
Sep 10 19:49:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f79bd9d3-71d4-4e68-9313-24cbe75a02ea tempest-VolumesDeleteCascade-111098653 None] Lock "cinder-5834d8f9-477b-4264-9bd6-12e01435b29a-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:50 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:50 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Flow 'volume_create_manager' (d322b45a-0169-4678-9dce-b184111ae446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bac97b-3bf4-44c6-b2ad-8fa0429b5718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bac97b-3bf4-44c6-b2ad-8fa0429b5718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-478607220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a9a222-c4e6-45c4-aa57-0562a378d1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6affb6d72f3a4d1cb99edeeeb5c985ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:49:51Z,use_quota=True,user_id='a9abb3502a9f477fb69533dae8401527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab61f1f2-beaa-469d-b0e4-ae24cc073c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab61f1f2-beaa-469d-b0e4-ae24cc073c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfff4776-d6a9-45c1-b813-0688c75738b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfff4776-d6a9-45c1-b813-0688c75738b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a9a222-c4e6-45c4-aa57-0562a378d1bd', 'volume_name': 'volume-44a9a222-c4e6-45c4-aa57-0562a378d1bd', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ee2ec6-9b5f-4aa0-9fbe-d98f3f77c3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ee2ec6-9b5f-4aa0-9fbe-d98f3f77c3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b03a374-dbe3-42c6-b7d6-8172d99f1dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:51 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Volume 44a9a222-c4e6-45c4-aa57-0562a378d1bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a9a222-c4e6-45c4-aa57-0562a378d1bd', 'volume_size': 1}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-478607220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a9a222-c4e6-45c4-aa57-0562a378d1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6affb6d72f3a4d1cb99edeeeb5c985ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:49:51Z,use_quota=True,user_id='a9abb3502a9f477fb69533dae8401527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Creating volume 44a9a222-c4e6-45c4-aa57-0562a378d1bd {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:49:51 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-44a9a222-c4e6-45c4-aa57-0562a378d1bd 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:51 devstack quobyte-client[82855]: System call of process 96540 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:49:51 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=124, name=volume-44a9a222-c4e6-45c4-aa57-0562a378d1bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-44a9a222-c4e6-45c4-aa57-0562a378d1bd 1073741824" returned: 0 in 0.336s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-44a9a222-c4e6-45c4-aa57-0562a378d1bd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-44a9a222-c4e6-45c4-aa57-0562a378d1bd" returned: 0 in 0.092s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] <== create_volume: return (500ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.514s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b03a374-dbe3-42c6-b7d6-8172d99f1dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a9a222-c4e6-45c4-aa57-0562a378d1bd', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4bfde12-a158-4f5a-9560-1275b6d94253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:51 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Volume volume-44a9a222-c4e6-45c4-aa57-0562a378d1bd (44a9a222-c4e6-45c4-aa57-0562a378d1bd): created successfully
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4bfde12-a158-4f5a-9560-1275b6d94253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Flow 'volume_create_manager' (d322b45a-0169-4678-9dce-b184111ae446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:49:51 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2be09e97-5d78-416f-aa5a-2102f4750fbc tempest-VolumesTransfersV355Test-882913462 None] Created volume successfully.
Sep 10 19:49:53 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-10f7ee8a-f98a-427e-b8bc-1f695b203889 tempest-VolumesTransfersV355Test-1035619952 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:53 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-10f7ee8a-f98a-427e-b8bc-1f695b203889 tempest-VolumesTransfersV355Test-1035619952 None] Transfer volume completed successfully.
Sep 10 19:49:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Acquiring lock "cinder-44a9a222-c4e6-45c4-aa57-0562a378d1bd-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Lock "cinder-44a9a222-c4e6-45c4-aa57-0562a378d1bd-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:54 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Acquiring lock "cinder-quobyte-44a9a222-c4e6-45c4-aa57-0562a378d1bd" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Lock "cinder-quobyte-44a9a222-c4e6-45c4-aa57-0562a378d1bd" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:54 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff504d8d-c7d2-4ecb-9179-aa4f679483a4]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-44a9a222-c4e6-45c4-aa57-0562a378d1bd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-44a9a222-c4e6-45c4-aa57-0562a378d1bd" returned: 0 in 0.389s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-44a9a222-c4e6-45c4-aa57-0562a378d1bd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-44a9a222-c4e6-45c4-aa57-0562a378d1bd" returned: 0 in 0.117s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Lock "cinder-quobyte-44a9a222-c4e6-45c4-aa57-0562a378d1bd" released by "delete_volume" :: held 0.649s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:55 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Created reservations ['72fe05d4-6355-47bb-8bce-f03a5d7e329c', 'c27214dc-03cb-4713-b948-131ec4dbf524', '6f6d8014-1e25-4ad6-a420-38d38d670cdb', 'db62244f-066c-4047-9786-993563348b96'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:49:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:49:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:49:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.150s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:55 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:49:55 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Deleted volume successfully.
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9c6c5698-c43f-4b3b-8b46-52214e9342fd tempest-VolumesTransfersV355Test-1649564002 None] Lock "cinder-44a9a222-c4e6-45c4-aa57-0562a378d1bd-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:49:56 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Flow 'volume_create_manager' (9d71f9a0-10ab-4f17-94c6-67a17a305939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb11e1f-79b7-4f84-9909-0b7b47c9e834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb11e1f-79b7-4f84-9909-0b7b47c9e834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-337886104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0140037-8f17-4eb5-8647-8e9b7a20bc0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6affb6d72f3a4d1cb99edeeeb5c985ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:49:56Z,use_quota=True,user_id='a9abb3502a9f477fb69533dae8401527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9c1734-837d-41b8-95bf-f2224fd9c387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9c1734-837d-41b8-95bf-f2224fd9c387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03bec053-4b51-4f1d-aae8-f6b47a6ef188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03bec053-4b51-4f1d-aae8-f6b47a6ef188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0140037-8f17-4eb5-8647-8e9b7a20bc0c', 'volume_name': 'volume-e0140037-8f17-4eb5-8647-8e9b7a20bc0c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8be4fcc-038c-40bb-af54-eecf7ef10545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8be4fcc-038c-40bb-af54-eecf7ef10545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e23b38f-7392-487b-b488-f41dbbfdb138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:56 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Volume e0140037-8f17-4eb5-8647-8e9b7a20bc0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0140037-8f17-4eb5-8647-8e9b7a20bc0c', 'volume_size': 1}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-337886104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0140037-8f17-4eb5-8647-8e9b7a20bc0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6affb6d72f3a4d1cb99edeeeb5c985ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:49:56Z,use_quota=True,user_id='a9abb3502a9f477fb69533dae8401527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Creating volume e0140037-8f17-4eb5-8647-8e9b7a20bc0c {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:49:56 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e0140037-8f17-4eb5-8647-8e9b7a20bc0c 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:56 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=125, name=volume-e0140037-8f17-4eb5-8647-8e9b7a20bc0c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:49:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e0140037-8f17-4eb5-8647-8e9b7a20bc0c 1073741824" returned: 0 in 0.339s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e0140037-8f17-4eb5-8647-8e9b7a20bc0c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e0140037-8f17-4eb5-8647-8e9b7a20bc0c" returned: 0 in 0.101s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] <== create_volume: return (503ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:49:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.515s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e23b38f-7392-487b-b488-f41dbbfdb138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0140037-8f17-4eb5-8647-8e9b7a20bc0c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3034db-b0b9-40a3-b913-017e3b08e306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:49:57 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Volume volume-e0140037-8f17-4eb5-8647-8e9b7a20bc0c (e0140037-8f17-4eb5-8647-8e9b7a20bc0c): created successfully
Sep 10 19:49:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3034db-b0b9-40a3-b913-017e3b08e306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:49:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Flow 'volume_create_manager' (9d71f9a0-10ab-4f17-94c6-67a17a305939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:49:57 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8d20e8a9-7f36-4c11-878f-180b3725e84d tempest-VolumesTransfersV355Test-882913462 None] Created volume successfully.
Sep 10 19:49:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Acquiring lock "cinder-e0140037-8f17-4eb5-8647-8e9b7a20bc0c-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Lock "cinder-e0140037-8f17-4eb5-8647-8e9b7a20bc0c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:59 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Acquiring lock "cinder-quobyte-e0140037-8f17-4eb5-8647-8e9b7a20bc0c" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:49:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Lock "cinder-quobyte-e0140037-8f17-4eb5-8647-8e9b7a20bc0c" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:49:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab78e7d-c363-4a16-b648-f3ee5aa10e14]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e0140037-8f17-4eb5-8647-8e9b7a20bc0c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e0140037-8f17-4eb5-8647-8e9b7a20bc0c" returned: 0 in 0.399s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e0140037-8f17-4eb5-8647-8e9b7a20bc0c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-e0140037-8f17-4eb5-8647-8e9b7a20bc0c" returned: 0 in 0.107s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Lock "cinder-quobyte-e0140037-8f17-4eb5-8647-8e9b7a20bc0c" released by "delete_volume" :: held 0.670s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:50:00 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Created reservations ['570c25db-c5c9-47df-b6db-3606ccac2157', '5f8984bb-28b5-4dc4-9240-bfcf0ad8867a', '38599c26-4199-418e-8a40-65e9650f58f3', '5de48aa5-329a-4e74-94f9-30b54265b40b'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:50:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:50:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:50:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:50:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:50:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:50:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:50:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.101s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:50:00 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:50:00 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Deleted volume successfully.
Sep 10 19:50:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-06cbdcf0-2d30-4df6-98c1-b0c6a6ddabae tempest-VolumesTransfersV355Test-1649564002 None] Lock "cinder-e0140037-8f17-4eb5-8647-8e9b7a20bc0c-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:50:10 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=54,cinder:UPDATE=70,cinder:DELETE=5,cinder:INSERT=18 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:50:10 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=70,cinder:SELECT=52,cinder:DELETE=8,cinder:INSERT=14 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:50:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:50:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:50:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:50:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:50:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:50:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:50:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:50:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.129s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:50:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:50:18 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Flow 'volume_create_manager' (af87dc75-9fb3-4c42-a90d-911341d293a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a29b499-7583-460c-9607-9aac82047838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a29b499-7583-460c-9607-9aac82047838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-530237787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa35e6f-5cd8-4319-aacd-3017e7f14138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf6179eba6c448dbf779875b85dd177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:50:18Z,use_quota=True,user_id='3f75a23866804b6690c6d86efed5870f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d732005-1088-48a7-a99b-2eee18b7e843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d732005-1088-48a7-a99b-2eee18b7e843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba54a641-47bf-4d24-9853-81f122bcf31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba54a641-47bf-4d24-9853-81f122bcf31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa35e6f-5cd8-4319-aacd-3017e7f14138', 'volume_name': 'volume-daa35e6f-5cd8-4319-aacd-3017e7f14138', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4e2136-3c3a-4b66-99e8-0ed82465b061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4e2136-3c3a-4b66-99e8-0ed82465b061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca0d284-54c1-411a-bc67-590782da7521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:50:18 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Volume daa35e6f-5cd8-4319-aacd-3017e7f14138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa35e6f-5cd8-4319-aacd-3017e7f14138', 'volume_size': 1}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-530237787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa35e6f-5cd8-4319-aacd-3017e7f14138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf6179eba6c448dbf779875b85dd177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:50:18Z,use_quota=True,user_id='3f75a23866804b6690c6d86efed5870f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Creating volume daa35e6f-5cd8-4319-aacd-3017e7f14138 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:50:18 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:50:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:50:18 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=126, name=volume-daa35e6f-5cd8-4319-aacd-3017e7f14138, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:50:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 1073741824" returned: 0 in 0.468s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:50:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:50:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138" returned: 0 in 0.101s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:50:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] <== create_volume: return (633ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:50:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.645s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:50:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca0d284-54c1-411a-bc67-590782da7521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa35e6f-5cd8-4319-aacd-3017e7f14138', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:50:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1824e275-994b-4f6b-9cae-737af5c0d70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:50:19 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Volume volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 (daa35e6f-5cd8-4319-aacd-3017e7f14138): created successfully
Sep 10 19:50:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1824e275-994b-4f6b-9cae-737af5c0d70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:50:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Flow 'volume_create_manager' (af87dc75-9fb3-4c42-a90d-911341d293a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:50:19 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2b59e2a6-8476-41a5-ab56-08754e5d6fb6 tempest-VolumesActionsTest-298556091 None] Created volume successfully.
Sep 10 19:50:29 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:50:29 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:50:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8c3ee5ba-7156-4e72-9936-a0d72d21e544 tempest-VolumesActionsTest-298556091 None] Acquiring lock "cinder-daa35e6f-5cd8-4319-aacd-3017e7f14138" by "attach_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:50:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8c3ee5ba-7156-4e72-9936-a0d72d21e544 tempest-VolumesActionsTest-298556091 None] Lock "cinder-daa35e6f-5cd8-4319-aacd-3017e7f14138" acquired by "attach_volume" :: waited 0.023s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:50:44 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-8c3ee5ba-7156-4e72-9936-a0d72d21e544 tempest-VolumesActionsTest-298556091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:50:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8c3ee5ba-7156-4e72-9936-a0d72d21e544 tempest-VolumesActionsTest-298556091 None] Attaching volume daa35e6f-5cd8-4319-aacd-3017e7f14138 to instance 787c3f60-5e99-4275-bb2d-2ef545303f72 at mountpoint /dev/vdb on host None.
Sep 10 19:50:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8c3ee5ba-7156-4e72-9936-a0d72d21e544 tempest-VolumesActionsTest-298556091 None] Attach volume completed successfully.
Sep 10 19:50:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8c3ee5ba-7156-4e72-9936-a0d72d21e544 tempest-VolumesActionsTest-298556091 None] Lock "cinder-daa35e6f-5cd8-4319-aacd-3017e7f14138" released by "attach_volume" :: held 0.237s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:50:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d0270ea1-f28c-4b32-b10b-19db36c056ea tempest-VolumesActionsTest-298556091 None] Acquiring lock "cinder-daa35e6f-5cd8-4319-aacd-3017e7f14138-detach_volume" by "detach_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:50:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d0270ea1-f28c-4b32-b10b-19db36c056ea tempest-VolumesActionsTest-298556091 None] Lock "cinder-daa35e6f-5cd8-4319-aacd-3017e7f14138-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:50:44 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d0270ea1-f28c-4b32-b10b-19db36c056ea tempest-VolumesActionsTest-298556091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:50:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d0270ea1-f28c-4b32-b10b-19db36c056ea tempest-VolumesActionsTest-298556091 None] Detaching volume daa35e6f-5cd8-4319-aacd-3017e7f14138 from instance 787c3f60-5e99-4275-bb2d-2ef545303f72.
Sep 10 19:50:44 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d0270ea1-f28c-4b32-b10b-19db36c056ea tempest-VolumesActionsTest-298556091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:50:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d0270ea1-f28c-4b32-b10b-19db36c056ea tempest-VolumesActionsTest-298556091 None] Detach volume completed successfully.
Sep 10 19:50:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d0270ea1-f28c-4b32-b10b-19db36c056ea tempest-VolumesActionsTest-298556091 None] Lock "cinder-daa35e6f-5cd8-4319-aacd-3017e7f14138-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:50:54 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:50:54 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:INSERT=2,cinder:SELECT=7,cinder:UPDATE=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:51:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:51:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:51:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:51:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:51:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:51:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:51:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.132s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:51:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c186e148-daf9-48d1-aab5-acb3ab0258fe tempest-VolumesActionsTest-298556091 None] Acquiring lock "cinder-daa35e6f-5cd8-4319-aacd-3017e7f14138" by "attach_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:51:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c186e148-daf9-48d1-aab5-acb3ab0258fe tempest-VolumesActionsTest-298556091 None] Lock "cinder-daa35e6f-5cd8-4319-aacd-3017e7f14138" acquired by "attach_volume" :: waited 0.060s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:51:16 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c186e148-daf9-48d1-aab5-acb3ab0258fe tempest-VolumesActionsTest-298556091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:51:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c186e148-daf9-48d1-aab5-acb3ab0258fe tempest-VolumesActionsTest-298556091 None] Attaching volume daa35e6f-5cd8-4319-aacd-3017e7f14138 to instance f34fc14a-b80f-47eb-ad15-768f34ae8ec6 at mountpoint /dev/vdb on host None.
Sep 10 19:51:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c186e148-daf9-48d1-aab5-acb3ab0258fe tempest-VolumesActionsTest-298556091 None] Attach volume completed successfully.
Sep 10 19:51:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c186e148-daf9-48d1-aab5-acb3ab0258fe tempest-VolumesActionsTest-298556091 None] Lock "cinder-daa35e6f-5cd8-4319-aacd-3017e7f14138" released by "attach_volume" :: held 0.320s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:51:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-47123022-3587-4bb6-95f7-4069204b29c3 tempest-VolumesActionsTest-298556091 None] Acquiring lock "cinder-daa35e6f-5cd8-4319-aacd-3017e7f14138-detach_volume" by "detach_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:51:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-47123022-3587-4bb6-95f7-4069204b29c3 tempest-VolumesActionsTest-298556091 None] Lock "cinder-daa35e6f-5cd8-4319-aacd-3017e7f14138-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:51:16 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-47123022-3587-4bb6-95f7-4069204b29c3 tempest-VolumesActionsTest-298556091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:51:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-47123022-3587-4bb6-95f7-4069204b29c3 tempest-VolumesActionsTest-298556091 None] Detaching volume daa35e6f-5cd8-4319-aacd-3017e7f14138 from instance f34fc14a-b80f-47eb-ad15-768f34ae8ec6.
Sep 10 19:51:16 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-47123022-3587-4bb6-95f7-4069204b29c3 tempest-VolumesActionsTest-298556091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:51:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-47123022-3587-4bb6-95f7-4069204b29c3 tempest-VolumesActionsTest-298556091 None] Detach volume completed successfully.
Sep 10 19:51:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-47123022-3587-4bb6-95f7-4069204b29c3 tempest-VolumesActionsTest-298556091 None] Lock "cinder-daa35e6f-5cd8-4319-aacd-3017e7f14138-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:51:29 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:51:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:51:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:51:29 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a3388b-3e99-4b99-8d03-d58ce1917675]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:51:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138" returned: 0 in 0.436s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:29 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7551d569-fd9a-4f0c-8947-90a5e4e3a723]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:51:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138" returned: 0 in 0.391s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 /opt/stack/data/cinder/conversion/daa35e6f-5cd8-4319-aacd-3017e7f14138.temp_image.63fdff0e-5452-448a-b564-f9dd5cb9d3c721atvmky.img {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:INSERT=1,cinder:SELECT=8,cinder:UPDATE=3 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:51:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 /opt/stack/data/cinder/conversion/daa35e6f-5cd8-4319-aacd-3017e7f14138.temp_image.63fdff0e-5452-448a-b564-f9dd5cb9d3c721atvmky.img" returned: 0 in 6.101s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:36 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d13ad6f-a140-49af-8952-567d8768b200]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:51:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138" returned: 0 in 0.525s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:36 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] Image conversion details: src /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/conversion/daa35e6f-5cd8-4319-aacd-3017e7f14138.temp_image.63fdff0e-5452-448a-b564-f9dd5cb9d3c721atvmky.img {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:51:36 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] Converted 1024.00 MB image at 167.67 MB/s
Sep 10 19:51:36 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] 63fdff0e-5452-448a-b564-f9dd5cb9d3c7 was raw, no need to convert to raw {{(pid=82850) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 10 19:51:39 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:51:46 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:52:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 43.985s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] Uploaded volume to glance image-id: 63fdff0e-5452-448a-b564-f9dd5cb9d3c7. {{(pid=82850) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 10 19:52:13 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-42455191-590c-47f6-9d6e-a3c83665c81f tempest-VolumesActionsTest-298556091 None] Copy volume to image completed successfully.
Sep 10 19:52:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:52:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.100s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:52:15 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:15 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b57cc3b-1406-4c64-a31f-5411dbc7941c]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138" returned: 0 in 0.406s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:15 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca79abc-678a-4970-8897-1f790333631a]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138" returned: 0 in 0.370s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 /opt/stack/data/cinder/conversion/daa35e6f-5cd8-4319-aacd-3017e7f14138.temp_image.d988f2d4-aa54-4e88-b09f-560d4f01de65mzt92u5b.img {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:23 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:52:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 /opt/stack/data/cinder/conversion/daa35e6f-5cd8-4319-aacd-3017e7f14138.temp_image.d988f2d4-aa54-4e88-b09f-560d4f01de65mzt92u5b.img" returned: 0 in 7.124s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:23 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[31025a53-598c-4e32-b48c-6e25d85c1acd]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138" returned: 0 in 0.752s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:24 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Image conversion details: src /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138, size 1024.00 MB, duration 7.13 sec, destination /opt/stack/data/cinder/conversion/daa35e6f-5cd8-4319-aacd-3017e7f14138.temp_image.d988f2d4-aa54-4e88-b09f-560d4f01de65mzt92u5b.img {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:52:24 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Converted 1024.00 MB image at 143.58 MB/s
Sep 10 19:52:24 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] d988f2d4-aa54-4e88-b09f-560d4f01de65 was raw, converting to qcow2 {{(pid=82850) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 10 19:52:24 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb460633-7d37-4fcd-8c98-66adfe0a57b9]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/daa35e6f-5cd8-4319-aacd-3017e7f14138.temp_image.d988f2d4-aa54-4e88-b09f-560d4f01de65mzt92u5b.img {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/daa35e6f-5cd8-4319-aacd-3017e7f14138.temp_image.d988f2d4-aa54-4e88-b09f-560d4f01de65mzt92u5b.img" returned: 0 in 0.424s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/daa35e6f-5cd8-4319-aacd-3017e7f14138.temp_image.d988f2d4-aa54-4e88-b09f-560d4f01de65mzt92u5b.img {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:25 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:52:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/daa35e6f-5cd8-4319-aacd-3017e7f14138.temp_image.d988f2d4-aa54-4e88-b09f-560d4f01de65mzt92u5b.img" returned: 1 in 0.539s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/daa35e6f-5cd8-4319-aacd-3017e7f14138.temp_image.d988f2d4-aa54-4e88-b09f-560d4f01de65mzt92u5b.img' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:52:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/daa35e6f-5cd8-4319-aacd-3017e7f14138.temp_image.d988f2d4-aa54-4e88-b09f-560d4f01de65mzt92u5b.img /opt/stack/data/cinder/conversion/vol_upload_soqgkdix {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/daa35e6f-5cd8-4319-aacd-3017e7f14138.temp_image.d988f2d4-aa54-4e88-b09f-560d4f01de65mzt92u5b.img /opt/stack/data/cinder/conversion/vol_upload_soqgkdix" returned: 0 in 0.204s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:25 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Image conversion details: src /opt/stack/data/cinder/conversion/daa35e6f-5cd8-4319-aacd-3017e7f14138.temp_image.d988f2d4-aa54-4e88-b09f-560d4f01de65mzt92u5b.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_soqgkdix {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:52:25 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 10 19:52:25 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c274815-90b0-4003-83e6-da003439765e]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_soqgkdix {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_soqgkdix" returned: 0 in 0.404s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.378s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Uploaded volume to glance image-id: d988f2d4-aa54-4e88-b09f-560d4f01de65. {{(pid=82850) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 10 19:52:27 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a989bc68-1d75-47e2-8a58-faa35144ed7f tempest-VolumesActionsTest-298556091 None] Copy volume to image completed successfully.
Sep 10 19:52:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Acquiring lock "cinder-daa35e6f-5cd8-4319-aacd-3017e7f14138-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Lock "cinder-daa35e6f-5cd8-4319-aacd-3017e7f14138-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:29 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Acquiring lock "cinder-quobyte-daa35e6f-5cd8-4319-aacd-3017e7f14138" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Lock "cinder-quobyte-daa35e6f-5cd8-4319-aacd-3017e7f14138" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:29 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5052c1de-f658-4602-9506-26c2400d3ee1]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138" returned: 0 in 0.418s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-daa35e6f-5cd8-4319-aacd-3017e7f14138" returned: 0 in 0.084s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Lock "cinder-quobyte-daa35e6f-5cd8-4319-aacd-3017e7f14138" released by "delete_volume" :: held 0.649s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:30 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Created reservations ['a0025f23-eecf-4244-8c83-d87f7ab094c7', 'c75fef4a-a7bd-4785-b017-32de28d4ff0c', 'ff678714-3ecb-43a6-a265-4bc696a64fc0', '67c0ded3-beb9-4be0-894f-75c09d6c4228'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:52:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.082s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:30 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:52:30 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Deleted volume successfully.
Sep 10 19:52:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7031cf23-593f-450b-8b13-adbe3379a5dc tempest-VolumesActionsTest-298556091 None] Lock "cinder-daa35e6f-5cd8-4319-aacd-3017e7f14138-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:39 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Flow 'volume_create_manager' (d36a501e-762d-45db-93c1-f62215fb4ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798b32dd-55cd-4eb4-93f9-d0c596f97124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798b32dd-55cd-4eb4-93f9-d0c596f97124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2016735166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917b5fb1-bee7-495b-a6c3-b46b3b03faec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591615ba1e644a1db90cb02749e452bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:40Z,use_quota=True,user_id='a4f4967736fc4aa58ce8579f9341df66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e074bc9-4c3d-45ba-ac21-ecce70883711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e074bc9-4c3d-45ba-ac21-ecce70883711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce3378c-93a2-4ed2-acb4-544ab4b49e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce3378c-93a2-4ed2-acb4-544ab4b49e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '917b5fb1-bee7-495b-a6c3-b46b3b03faec', 'volume_name': 'volume-917b5fb1-bee7-495b-a6c3-b46b3b03faec', 'volume_size': 2}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645f3a8f-1aa0-49af-8274-6b50c8c29d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645f3a8f-1aa0-49af-8274-6b50c8c29d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ede99d8-f926-474c-bc28-4df7f9fbac1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:39 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Volume 917b5fb1-bee7-495b-a6c3-b46b3b03faec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-917b5fb1-bee7-495b-a6c3-b46b3b03faec', 'volume_size': 2}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2016735166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917b5fb1-bee7-495b-a6c3-b46b3b03faec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591615ba1e644a1db90cb02749e452bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:40Z,use_quota=True,user_id='a4f4967736fc4aa58ce8579f9341df66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Creating volume 917b5fb1-bee7-495b-a6c3-b46b3b03faec {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:52:39 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:52:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-917b5fb1-bee7-495b-a6c3-b46b3b03faec 2147483648 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:40 devstack quobyte-client[82855]: System call of process 97049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:52:40 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=127, name=volume-917b5fb1-bee7-495b-a6c3-b46b3b03faec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:52:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-917b5fb1-bee7-495b-a6c3-b46b3b03faec 2147483648" returned: 0 in 0.579s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-917b5fb1-bee7-495b-a6c3-b46b3b03faec {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-917b5fb1-bee7-495b-a6c3-b46b3b03faec" returned: 0 in 0.113s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] <== create_volume: return (769ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:52:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:40 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:52:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ede99d8-f926-474c-bc28-4df7f9fbac1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-917b5fb1-bee7-495b-a6c3-b46b3b03faec', 'volume_size': 2}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e012784d-83a3-4462-acaa-978bd19f0cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:40 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Volume volume-917b5fb1-bee7-495b-a6c3-b46b3b03faec (917b5fb1-bee7-495b-a6c3-b46b3b03faec): created successfully
Sep 10 19:52:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e012784d-83a3-4462-acaa-978bd19f0cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Flow 'volume_create_manager' (d36a501e-762d-45db-93c1-f62215fb4ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:41 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-feffed01-b91a-4357-8d18-c9d2b715fe9b tempest-VolumesCloneNegativeTest-1520060434 None] Created volume successfully.
Sep 10 19:52:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Acquiring lock "cinder-917b5fb1-bee7-495b-a6c3-b46b3b03faec-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Lock "cinder-917b5fb1-bee7-495b-a6c3-b46b3b03faec-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:42 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Acquiring lock "cinder-quobyte-917b5fb1-bee7-495b-a6c3-b46b3b03faec" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Lock "cinder-quobyte-917b5fb1-bee7-495b-a6c3-b46b3b03faec" acquired by "delete_volume" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:42 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[448dad7a-e07e-470b-a8f5-c340648eac0d]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-917b5fb1-bee7-495b-a6c3-b46b3b03faec {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-917b5fb1-bee7-495b-a6c3-b46b3b03faec" returned: 0 in 0.445s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-917b5fb1-bee7-495b-a6c3-b46b3b03faec {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-917b5fb1-bee7-495b-a6c3-b46b3b03faec" returned: 0 in 0.097s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Lock "cinder-quobyte-917b5fb1-bee7-495b-a6c3-b46b3b03faec" released by "delete_volume" :: held 0.690s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:43 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Created reservations ['271e85cd-4a39-49e0-a30a-48f561601ca2', 'ca221fe4-24dd-45a5-8d2e-476f56145080', 'bb823484-ee05-4993-9305-79755de41e40', '549c240b-1e3c-494c-bb94-57956e1c565f'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:52:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.111s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:43 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:52:43 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Deleted volume successfully.
Sep 10 19:52:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d9eb97a-6ad2-43b1-8bee-3d4054192bc0 tempest-VolumesCloneNegativeTest-1520060434 None] Lock "cinder-917b5fb1-bee7-495b-a6c3-b46b3b03faec-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:50 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:50 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Flow 'volume_create_manager' (ed593f33-e11b-4d80-9afc-2cae0020fa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17c9a40-6eb5-4ad1-8563-d3e20653d629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17c9a40-6eb5-4ad1-8563-d3e20653d629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-420307814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71dcb2f-e0e0-44e4-9b3b-312ec75058cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89ec48e5d6e944088f723cb9b1505823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:51Z,use_quota=True,user_id='78f72cef115647298925f9dc69084524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d37f48-0334-4b54-892e-9da761ced3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d37f48-0334-4b54-892e-9da761ced3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab573fb8-8d03-494c-8ce4-1ede991c9602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab573fb8-8d03-494c-8ce4-1ede991c9602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd71dcb2f-e0e0-44e4-9b3b-312ec75058cc', 'volume_name': 'volume-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1821ad13-d0b9-4af4-b889-66ad95ff9619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1821ad13-d0b9-4af4-b889-66ad95ff9619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be8d07f-9953-4c95-b1de-f99c1d73dcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:51 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Volume d71dcb2f-e0e0-44e4-9b3b-312ec75058cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc', 'volume_size': 1}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-420307814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71dcb2f-e0e0-44e4-9b3b-312ec75058cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89ec48e5d6e944088f723cb9b1505823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:51Z,use_quota=True,user_id='78f72cef115647298925f9dc69084524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Creating volume d71dcb2f-e0e0-44e4-9b3b-312ec75058cc {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:52:51 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:51 devstack quobyte-client[82855]: System call of process 97059 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:52:51 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=128, name=volume-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc 1073741824" returned: 0 in 0.434s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc" returned: 0 in 0.088s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] <== create_volume: return (604ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.621s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be8d07f-9953-4c95-b1de-f99c1d73dcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b02a29-6432-4445-ac17-0425313bc940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:52 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Volume volume-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc (d71dcb2f-e0e0-44e4-9b3b-312ec75058cc): created successfully
Sep 10 19:52:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b02a29-6432-4445-ac17-0425313bc940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Flow 'volume_create_manager' (ed593f33-e11b-4d80-9afc-2cae0020fa25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:52 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c28bb6f2-db6b-4f42-acfd-e392504d5cec tempest-VolumesListTestJSON-58311323 None] Created volume successfully.
Sep 10 19:52:53 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Flow 'volume_create_manager' (6348614c-98ce-4a1d-9d38-3f9293ac2e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e65b37-778d-4656-92e8-70602a82f4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e65b37-778d-4656-92e8-70602a82f4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-671555529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89ec48e5d6e944088f723cb9b1505823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:53Z,use_quota=True,user_id='78f72cef115647298925f9dc69084524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647576f1-1459-4416-9584-59dcb410e7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647576f1-1459-4416-9584-59dcb410e7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d671dd27-fb04-44bb-8a15-cf0419e4c77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d671dd27-fb04-44bb-8a15-cf0419e4c77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f', 'volume_name': 'volume-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278f4b72-3137-4b86-9a14-c3af9c3aa2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278f4b72-3137-4b86-9a14-c3af9c3aa2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16099776-c96b-4ed6-87da-ef2e1b86ef0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:53 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Volume 45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f', 'volume_size': 1}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-671555529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89ec48e5d6e944088f723cb9b1505823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:53Z,use_quota=True,user_id='78f72cef115647298925f9dc69084524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Creating volume 45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:52:53 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:53 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=129, name=volume-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f 1073741824" returned: 0 in 0.346s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f" returned: 0 in 0.078s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] <== create_volume: return (481ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:52:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.491s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16099776-c96b-4ed6-87da-ef2e1b86ef0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317e97ef-01ff-4919-83c1-24977fe9b8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:54 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Volume volume-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f (45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f): created successfully
Sep 10 19:52:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317e97ef-01ff-4919-83c1-24977fe9b8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Flow 'volume_create_manager' (6348614c-98ce-4a1d-9d38-3f9293ac2e48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a1adc8ca-8ab0-427f-9fde-cf791887df0d tempest-VolumesListTestJSON-58311323 None] Created volume successfully.
Sep 10 19:52:56 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Flow 'volume_create_manager' (5234112b-6a7d-45b0-9c94-15de2cb91fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93efca4b-fccf-424f-b017-7ac73c83943c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93efca4b-fccf-424f-b017-7ac73c83943c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-588678013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01ed498-e838-43c9-b92e-af4fd2584f53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89ec48e5d6e944088f723cb9b1505823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:56Z,use_quota=True,user_id='78f72cef115647298925f9dc69084524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53be19a5-ab25-4126-a431-5e33bffe9e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53be19a5-ab25-4126-a431-5e33bffe9e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387ae6bd-1a21-4e77-9fac-f53d52c6ea7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387ae6bd-1a21-4e77-9fac-f53d52c6ea7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01ed498-e838-43c9-b92e-af4fd2584f53', 'volume_name': 'volume-a01ed498-e838-43c9-b92e-af4fd2584f53', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f1dc51-3faa-4a07-b189-935d23412a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f1dc51-3faa-4a07-b189-935d23412a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fd2c03-ab18-4429-9fa8-15d9305d9d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:56 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Volume a01ed498-e838-43c9-b92e-af4fd2584f53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01ed498-e838-43c9-b92e-af4fd2584f53', 'volume_size': 1}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-588678013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01ed498-e838-43c9-b92e-af4fd2584f53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89ec48e5d6e944088f723cb9b1505823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:56Z,use_quota=True,user_id='78f72cef115647298925f9dc69084524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Creating volume a01ed498-e838-43c9-b92e-af4fd2584f53 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:52:56 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a01ed498-e838-43c9-b92e-af4fd2584f53 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:56 devstack quobyte-client[82855]: System call of process 97069 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:52:56 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=130, name=volume-a01ed498-e838-43c9-b92e-af4fd2584f53, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a01ed498-e838-43c9-b92e-af4fd2584f53 1073741824" returned: 0 in 0.416s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a01ed498-e838-43c9-b92e-af4fd2584f53 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a01ed498-e838-43c9-b92e-af4fd2584f53" returned: 0 in 0.087s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] <== create_volume: return (592ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.610s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fd2c03-ab18-4429-9fa8-15d9305d9d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01ed498-e838-43c9-b92e-af4fd2584f53', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411b03a2-31bc-4e53-ba08-7b9ea981e9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:57 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Volume volume-a01ed498-e838-43c9-b92e-af4fd2584f53 (a01ed498-e838-43c9-b92e-af4fd2584f53): created successfully
Sep 10 19:52:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411b03a2-31bc-4e53-ba08-7b9ea981e9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Flow 'volume_create_manager' (5234112b-6a7d-45b0-9c94-15de2cb91fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:57 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-addc6c25-a507-4e44-8b4e-91042d47d827 tempest-VolumesListTestJSON-58311323 None] Created volume successfully.
Sep 10 19:53:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Acquiring lock "cinder-a01ed498-e838-43c9-b92e-af4fd2584f53-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Lock "cinder-a01ed498-e838-43c9-b92e-af4fd2584f53-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Acquiring lock "cinder-quobyte-a01ed498-e838-43c9-b92e-af4fd2584f53" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Lock "cinder-quobyte-a01ed498-e838-43c9-b92e-af4fd2584f53" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:02 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[845d093c-f1f7-43a0-a856-7e7b972e783c]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a01ed498-e838-43c9-b92e-af4fd2584f53 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a01ed498-e838-43c9-b92e-af4fd2584f53" returned: 0 in 0.454s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a01ed498-e838-43c9-b92e-af4fd2584f53 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a01ed498-e838-43c9-b92e-af4fd2584f53" returned: 0 in 0.106s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Lock "cinder-quobyte-a01ed498-e838-43c9-b92e-af4fd2584f53" released by "delete_volume" :: held 0.730s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:03 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Created reservations ['12382e10-53e1-4eca-8a4c-d2538c272bd0', 'e9817afe-f39c-46f6-b657-13481c3afcb8', '2fe144ad-4e5f-4c7c-89cd-d6206c657fc2', '46a9418f-20a6-415d-8c7f-8a33e8b38108'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:53:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.084s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:03 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:53:03 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Deleted volume successfully.
Sep 10 19:53:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-02192e22-a968-4653-a789-4c311e49daa7 tempest-VolumesListTestJSON-58311323 None] Lock "cinder-a01ed498-e838-43c9-b92e-af4fd2584f53-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Acquiring lock "cinder-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Lock "cinder-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:04 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Acquiring lock "cinder-quobyte-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Lock "cinder-quobyte-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:04 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[87384234-b2ae-4a12-b4a6-3cd5f978593f]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f" returned: 0 in 0.460s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f" returned: 0 in 0.146s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Lock "cinder-quobyte-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f" released by "delete_volume" :: held 0.688s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:05 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Created reservations ['fe65e48d-e198-4793-bc75-aa2e0ca07dd7', '7d5b5ca6-0c54-476c-826d-36daea28ea59', '7bb6cc04-9827-42ea-88d4-629c926c8398', 'd4fdafe1-db65-49e6-9b67-a16d89b945fe'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:53:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.087s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:05 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:53:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Deleted volume successfully.
Sep 10 19:53:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-82e191dc-10fd-48c7-a737-59209a3e44c1 tempest-VolumesListTestJSON-58311323 None] Lock "cinder-45fd4acf-1c7f-4bd6-96de-91c4bb26ba1f-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Acquiring lock "cinder-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Lock "cinder-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:06 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Acquiring lock "cinder-quobyte-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Lock "cinder-quobyte-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8dd4c0-b0c0-45cb-addc-66304a8e8370]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc" returned: 0 in 0.384s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc" returned: 0 in 0.103s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Lock "cinder-quobyte-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc" released by "delete_volume" :: held 0.626s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:07 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Created reservations ['ec68a192-c4fb-4ea5-83d9-b5938c4ac2ef', '12963c8a-5728-4e3a-b582-29104e149e13', 'bf265c4b-9998-410d-9b4a-e776b0006e2f', '83b98d3e-7c1d-4413-9c5a-f8559592ca89'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:53:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.101s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:07 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:53:08 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Deleted volume successfully.
Sep 10 19:53:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-343e4a60-644c-4441-81ff-602d5324aef8 tempest-VolumesListTestJSON-58311323 None] Lock "cinder-d71dcb2f-e0e0-44e4-9b3b-312ec75058cc-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:53:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.303s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:53:17 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=26,cinder:INSERT=10,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:53:18 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=28,cinder:INSERT=8,cinder:UPDATE=60,cinder:DELETE=5 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:53:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:53:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:53:41 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Flow 'volume_create_manager' (382e719c-ac9f-48e8-9c81-888f3e8ec1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d70ab0-a475-4a27-9623-f882e66b7959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d70ab0-a475-4a27-9623-f882e66b7959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1786267977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db03b1cf-0428-409b-9584-1a1421c30d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5330834c6c24564a217b9e7627df622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:41Z,use_quota=True,user_id='cacc8fedb9ab4a288df4d9600f82d6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbab3bed-63a4-4d7e-81fe-1ecbfc3a7f81),volume_type_id=bbab3bed-63a4-4d7e-81fe-1ecbfc3a7f81)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94573aef-fc1d-49df-92fc-ae8f8b30a273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94573aef-fc1d-49df-92fc-ae8f8b30a273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ddfac5-61f2-4128-88d4-a268b0940f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ddfac5-61f2-4128-88d4-a268b0940f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db03b1cf-0428-409b-9584-1a1421c30d1d', 'volume_name': 'volume-db03b1cf-0428-409b-9584-1a1421c30d1d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a118ed74-7531-44a4-a9a5-0041acfac15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a118ed74-7531-44a4-a9a5-0041acfac15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b1aa59-cb24-4b3a-bf34-9f038f255a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:41 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume db03b1cf-0428-409b-9584-1a1421c30d1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db03b1cf-0428-409b-9584-1a1421c30d1d', 'volume_size': 1}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1786267977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db03b1cf-0428-409b-9584-1a1421c30d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5330834c6c24564a217b9e7627df622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:41Z,use_quota=True,user_id='cacc8fedb9ab4a288df4d9600f82d6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbab3bed-63a4-4d7e-81fe-1ecbfc3a7f81),volume_type_id=bbab3bed-63a4-4d7e-81fe-1ecbfc3a7f81)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Creating volume db03b1cf-0428-409b-9584-1a1421c30d1d {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:53:41 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:53:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-db03b1cf-0428-409b-9584-1a1421c30d1d 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:41 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=131, name=volume-db03b1cf-0428-409b-9584-1a1421c30d1d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-db03b1cf-0428-409b-9584-1a1421c30d1d 1073741824" returned: 0 in 0.743s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-db03b1cf-0428-409b-9584-1a1421c30d1d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:42 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Flow 'volume_create_manager' (d0e9730e-a237-4341-a5db-9774a7b56f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83b398f-bf22-4915-9838-cf82935e5372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83b398f-bf22-4915-9838-cf82935e5372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1471981643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38424d33-d214-443d-86f3-6ec4175ed2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5330834c6c24564a217b9e7627df622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:42Z,use_quota=True,user_id='cacc8fedb9ab4a288df4d9600f82d6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26ea7171-9078-4d33-bafb-33beb6c71aa8),volume_type_id=26ea7171-9078-4d33-bafb-33beb6c71aa8)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97eceded-9e06-4c5f-9c6d-107f33fc1b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97eceded-9e06-4c5f-9c6d-107f33fc1b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf5cb0a-ba57-4a38-b875-cc0af6275703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf5cb0a-ba57-4a38-b875-cc0af6275703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38424d33-d214-443d-86f3-6ec4175ed2fe', 'volume_name': 'volume-38424d33-d214-443d-86f3-6ec4175ed2fe', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bff39f-d875-471b-b304-d134e6fe7c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bff39f-d875-471b-b304-d134e6fe7c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8610787b-d682-4bd1-9b1a-e324f0d46fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:42 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume 38424d33-d214-443d-86f3-6ec4175ed2fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38424d33-d214-443d-86f3-6ec4175ed2fe', 'volume_size': 1}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-db03b1cf-0428-409b-9584-1a1421c30d1d" returned: 0 in 0.630s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] <== create_volume: return (1418ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1471981643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38424d33-d214-443d-86f3-6ec4175ed2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5330834c6c24564a217b9e7627df622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:42Z,use_quota=True,user_id='cacc8fedb9ab4a288df4d9600f82d6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26ea7171-9078-4d33-bafb-33beb6c71aa8),volume_type_id=26ea7171-9078-4d33-bafb-33beb6c71aa8)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Creating volume 38424d33-d214-443d-86f3-6ec4175ed2fe {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:53:42 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:53:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-38424d33-d214-443d-86f3-6ec4175ed2fe 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:43 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=132, name=volume-38424d33-d214-443d-86f3-6ec4175ed2fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:53:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b1aa59-cb24-4b3a-bf34-9f038f255a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db03b1cf-0428-409b-9584-1a1421c30d1d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475c9dcd-d156-4267-857f-ab6e1805e6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-38424d33-d214-443d-86f3-6ec4175ed2fe 1073741824" returned: 0 in 0.509s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-38424d33-d214-443d-86f3-6ec4175ed2fe {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:43 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume volume-db03b1cf-0428-409b-9584-1a1421c30d1d (db03b1cf-0428-409b-9584-1a1421c30d1d): created successfully
Sep 10 19:53:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475c9dcd-d156-4267-857f-ab6e1805e6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Flow 'volume_create_manager' (382e719c-ac9f-48e8-9c81-888f3e8ec1d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:43 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:43 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:53:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Flow 'volume_create_manager' (0cf3db89-5a06-4f52-9718-3c2ac78c1cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f268811-e54b-4f17-a191-7e705401b0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-38424d33-d214-443d-86f3-6ec4175ed2fe" returned: 0 in 0.393s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] <== create_volume: return (944ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:53:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:43 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1e5b251e-8206-4646-a9b2-c403262aa007 tempest-TestInstancesWithCinderVolumes-1215805251 None] Created volume successfully.
Sep 10 19:53:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f268811-e54b-4f17-a191-7e705401b0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1012408043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ad55b2-09b1-419c-9f60-298de9a05bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5330834c6c24564a217b9e7627df622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:43Z,use_quota=True,user_id='cacc8fedb9ab4a288df4d9600f82d6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(184b8650-5f01-42b3-8af2-6180cd4e405e),volume_type_id=184b8650-5f01-42b3-8af2-6180cd4e405e)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0eaa4d-5ea0-49b3-8103-682ce01e8a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0eaa4d-5ea0-49b3-8103-682ce01e8a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fc1d10-06fa-4f91-b0a6-9c47749965dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8610787b-d682-4bd1-9b1a-e324f0d46fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38424d33-d214-443d-86f3-6ec4175ed2fe', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e2eb26-c191-4874-b7c8-24d5e9ef98e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:44 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume volume-38424d33-d214-443d-86f3-6ec4175ed2fe (38424d33-d214-443d-86f3-6ec4175ed2fe): created successfully
Sep 10 19:53:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e2eb26-c191-4874-b7c8-24d5e9ef98e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Flow 'volume_create_manager' (d0e9730e-a237-4341-a5db-9774a7b56f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fc1d10-06fa-4f91-b0a6-9c47749965dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '32ad55b2-09b1-419c-9f60-298de9a05bec', 'volume_name': 'volume-32ad55b2-09b1-419c-9f60-298de9a05bec', 'volume_size': 1, 'image_id': 'd23f3f2e-21f6-4a1e-b657-874964ed3ec5', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--801198091', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5330834c6c24564a217b9e7627df622', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23f3f2e-21f6-4a1e-b657-874964ed3ec5', 'created_at': datetime.datetime(2025, 9, 10, 17, 53, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 53, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23f3f2e-21f6-4a1e-b657-874964ed3ec5/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc578b08250>}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d09d40-097c-46a9-bcd6-bdde3dc1beae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d09d40-097c-46a9-bcd6-bdde3dc1beae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5e2e29-558e-4317-b51b-bc748ccc01a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:44 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume 32ad55b2-09b1-419c-9f60-298de9a05bec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-32ad55b2-09b1-419c-9f60-298de9a05bec', 'volume_size': 1, 'image_id': 'd23f3f2e-21f6-4a1e-b657-874964ed3ec5', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--801198091', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5330834c6c24564a217b9e7627df622', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23f3f2e-21f6-4a1e-b657-874964ed3ec5', 'created_at': datetime.datetime(2025, 9, 10, 17, 53, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 53, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23f3f2e-21f6-4a1e-b657-874964ed3ec5/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc578b08250>}
Sep 10 19:53:44 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Cloning 32ad55b2-09b1-419c-9f60-298de9a05bec from image d23f3f2e-21f6-4a1e-b657-874964ed3ec5  at location (None, None). {{(pid=82850) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 19:53:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-11b1742b-9047-4ee1-bb32-aa660e8c23fe tempest-TestInstancesWithCinderVolumes-1215805251 None] Created volume successfully.
Sep 10 19:53:45 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_fkjyut98devstack@QuobyteHD, size 20.69 MB, duration 1.54 sec {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 19:53:45 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Image download 20.69 MB at 13.45 MB/s
Sep 10 19:53:45 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b40200e-9146-4c71-b2db-377decc67a9c]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_fkjyut98devstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:46 devstack sudo[97143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_fkjyut98devstack@QuobyteHD
Sep 10 19:53:46 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:53:48 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root
Sep 10 19:53:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_fkjyut98devstack@QuobyteHD" returned: 0 in 3.052s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:48 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Temporary image d23f3f2e-21f6-4a1e-b657-874964ed3ec5 is fetched for user cacc8fedb9ab4a288df4d9600f82d6fd. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 19:53:49 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[594afd86-9726-4e16-8025-95df23b421c0]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_fkjyut98devstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:49 devstack sudo[97149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_fkjyut98devstack@QuobyteHD
Sep 10 19:53:49 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:53:51 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_fkjyut98devstack@QuobyteHD" returned: 0 in 2.016s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1012408043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ad55b2-09b1-419c-9f60-298de9a05bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5330834c6c24564a217b9e7627df622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:43Z,use_quota=True,user_id='cacc8fedb9ab4a288df4d9600f82d6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(184b8650-5f01-42b3-8af2-6180cd4e405e),volume_type_id=184b8650-5f01-42b3-8af2-6180cd4e405e)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Creating volume 32ad55b2-09b1-419c-9f60-298de9a05bec {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:53:51 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:51 devstack quobyte-client[82855]: System call of process 97154 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:51 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=133, name=volume-32ad55b2-09b1-419c-9f60-298de9a05bec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec 1073741824" returned: 0 in 0.351s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec" returned: 0 in 0.110s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] <== create_volume: return (541ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:53:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.571s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:52 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Attempting download of d23f3f2e-21f6-4a1e-b657-874964ed3ec5 ((None, None)) to volume 32ad55b2-09b1-419c-9f60-298de9a05bec. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 19:53:52 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[77532ebb-bea9-4ded-9868-b0eea431997d]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_gy8fvyyd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_gy8fvyyd" returned: 0 in 0.354s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_gy8fvyyd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_gy8fvyyd" returned: 1 in 0.389s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_gy8fvyyd' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:53:53 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ffe809-d93a-4b2f-ae62-8fa56f095297]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_fkjyut98devstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_fkjyut98devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:53 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] d23f3f2e-21f6-4a1e-b657-874964ed3ec5 was qcow2, converting to raw {{(pid=82850) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 19:53:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_fkjyut98devstack@QuobyteHD /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:53 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=133, name=volume-32ad55b2-09b1-419c-9f60-298de9a05bec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:53:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_fkjyut98devstack@QuobyteHD /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec" returned: 0 in 1.247s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:54 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d23f3f2e-21f6-4a1e-b657-874964ed3ec5_fkjyut98devstack@QuobyteHD, size 112.00 MB, duration 1.28 sec, destination /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:53:54 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Converted 112.00 MB image at 87.53 MB/s
Sep 10 19:53:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec 1G" returned: 0 in 0.160s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:55 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f43dd0e-9653-4f28-b62e-d7a00d1ea5d1]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec" returned: 0 in 0.379s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec" returned: 1 in 0.376s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:53:55 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Downloaded image d23f3f2e-21f6-4a1e-b657-874964ed3ec5 ((None, None)) to volume 32ad55b2-09b1-419c-9f60-298de9a05bec successfully. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 19:53:55 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Temporary image d23f3f2e-21f6-4a1e-b657-874964ed3ec5 for user cacc8fedb9ab4a288df4d9600f82d6fd is deleted. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 19:53:55 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Marking volume 32ad55b2-09b1-419c-9f60-298de9a05bec as bootable. {{(pid=82850) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 19:53:56 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Copying metadata from image d23f3f2e-21f6-4a1e-b657-874964ed3ec5 to 32ad55b2-09b1-419c-9f60-298de9a05bec. {{(pid=82850) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 19:53:56 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Creating volume glance metadata for volume 32ad55b2-09b1-419c-9f60-298de9a05bec backed by image d23f3f2e-21f6-4a1e-b657-874964ed3ec5 with: {'image_id': 'd23f3f2e-21f6-4a1e-b657-874964ed3ec5', 'image_name': 'tempest-scenario-img--801198091', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82850) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 19:53:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5e2e29-558e-4317-b51b-bc748ccc01a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32ad55b2-09b1-419c-9f60-298de9a05bec', 'volume_size': 1, 'image_id': 'd23f3f2e-21f6-4a1e-b657-874964ed3ec5', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--801198091', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5330834c6c24564a217b9e7627df622', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23f3f2e-21f6-4a1e-b657-874964ed3ec5', 'created_at': datetime.datetime(2025, 9, 10, 17, 53, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 53, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23f3f2e-21f6-4a1e-b657-874964ed3ec5/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc578b08250>}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1237445c-3dd0-4412-85a9-46c83335f9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:56 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume volume-32ad55b2-09b1-419c-9f60-298de9a05bec (32ad55b2-09b1-419c-9f60-298de9a05bec): created successfully
Sep 10 19:53:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1237445c-3dd0-4412-85a9-46c83335f9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Flow 'volume_create_manager' (0cf3db89-5a06-4f52-9718-3c2ac78c1cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:56 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ca3c4c6e-84f1-4f68-ae30-1ea7121e72bf tempest-TestInstancesWithCinderVolumes-1215805251 None] Created volume successfully.
Sep 10 19:54:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-d5435185-82ca-481e-b9c8-641b8b5b2061 req-51811d41-7f04-436d-9566-6b27b3872f1d tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:54:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-d5435185-82ca-481e-b9c8-641b8b5b2061 req-51811d41-7f04-436d-9566-6b27b3872f1d tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:54:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe5ea76-29fb-4ed4-b795-6ba7f45d0aed]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:54:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d5435185-82ca-481e-b9c8-641b8b5b2061 req-51811d41-7f04-436d-9566-6b27b3872f1d tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d5435185-82ca-481e-b9c8-641b8b5b2061 req-51811d41-7f04-436d-9566-6b27b3872f1d tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec" returned: 0 in 0.457s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d5435185-82ca-481e-b9c8-641b8b5b2061 req-51811d41-7f04-436d-9566-6b27b3872f1d tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d5435185-82ca-481e-b9c8-641b8b5b2061 req-51811d41-7f04-436d-9566-6b27b3872f1d tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec" returned: 1 in 0.432s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-d5435185-82ca-481e-b9c8-641b8b5b2061 req-51811d41-7f04-436d-9566-6b27b3872f1d tempest-TestInstancesWithCinderVolumes-1215805251 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:54:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-d5435185-82ca-481e-b9c8-641b8b5b2061 req-51811d41-7f04-436d-9566-6b27b3872f1d tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.034s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:54:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-d5435185-82ca-481e-b9c8-641b8b5b2061 req-51811d41-7f04-436d-9566-6b27b3872f1d tempest-TestInstancesWithCinderVolumes-1215805251 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-32ad55b2-09b1-419c-9f60-298de9a05bec', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac680847-d458-41f7-b72a-dddce760aeb6', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:54:07 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-d5435185-82ca-481e-b9c8-641b8b5b2061 req-51811d41-7f04-436d-9566-6b27b3872f1d tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:54:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-d5435185-82ca-481e-b9c8-641b8b5b2061 req-51811d41-7f04-436d-9566-6b27b3872f1d tempest-TestInstancesWithCinderVolumes-1215805251 None] attachment_update completed successfully.
Sep 10 19:54:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:54:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:54:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:54:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:54:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:54:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:54:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.133s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:54:17 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=18,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:54:17 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=9,cinder:SELECT=10,cinder:DELETE=2,cinder:INSERT=7 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:55:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:55:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:55:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:55:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:55:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:55:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:55:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:55:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.096s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:55:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:55:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-4a5565d2-39e3-4c6a-9e36-6615bce4783b req-13efe590-912d-4952-9a45-53b8cc717639 tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:55:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-4a5565d2-39e3-4c6a-9e36-6615bce4783b req-13efe590-912d-4952-9a45-53b8cc717639 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:55:19 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3099700-d760-4adc-b1ec-5df6a1ded4a4]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:55:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4a5565d2-39e3-4c6a-9e36-6615bce4783b req-13efe590-912d-4952-9a45-53b8cc717639 tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-db03b1cf-0428-409b-9584-1a1421c30d1d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:55:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4a5565d2-39e3-4c6a-9e36-6615bce4783b req-13efe590-912d-4952-9a45-53b8cc717639 tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-db03b1cf-0428-409b-9584-1a1421c30d1d" returned: 0 in 0.624s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:55:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-4a5565d2-39e3-4c6a-9e36-6615bce4783b req-13efe590-912d-4952-9a45-53b8cc717639 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.694s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:55:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-4a5565d2-39e3-4c6a-9e36-6615bce4783b req-13efe590-912d-4952-9a45-53b8cc717639 tempest-TestInstancesWithCinderVolumes-1215805251 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-db03b1cf-0428-409b-9584-1a1421c30d1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed562316-f13b-43eb-b7b7-32adb9cc0fe5', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:55:20 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-4a5565d2-39e3-4c6a-9e36-6615bce4783b req-13efe590-912d-4952-9a45-53b8cc717639 tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:55:20 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-4a5565d2-39e3-4c6a-9e36-6615bce4783b req-13efe590-912d-4952-9a45-53b8cc717639 tempest-TestInstancesWithCinderVolumes-1215805251 None] attachment_update completed successfully.
Sep 10 19:55:30 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:55:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-bfafe179-3e62-413c-805e-1e4166a06968 req-18d47848-35f5-4f1c-9ad7-413fda207481 tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:55:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-bfafe179-3e62-413c-805e-1e4166a06968 req-18d47848-35f5-4f1c-9ad7-413fda207481 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:55:30 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d17a6c-8339-4527-bfaf-48bd35eb801f]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:55:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-bfafe179-3e62-413c-805e-1e4166a06968 req-18d47848-35f5-4f1c-9ad7-413fda207481 tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-38424d33-d214-443d-86f3-6ec4175ed2fe {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:55:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-bfafe179-3e62-413c-805e-1e4166a06968 req-18d47848-35f5-4f1c-9ad7-413fda207481 tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-38424d33-d214-443d-86f3-6ec4175ed2fe" returned: 0 in 0.466s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:55:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-bfafe179-3e62-413c-805e-1e4166a06968 req-18d47848-35f5-4f1c-9ad7-413fda207481 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.514s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:55:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-bfafe179-3e62-413c-805e-1e4166a06968 req-18d47848-35f5-4f1c-9ad7-413fda207481 tempest-TestInstancesWithCinderVolumes-1215805251 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-38424d33-d214-443d-86f3-6ec4175ed2fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ba11cb9-53d2-4c6d-92db-0e6fd9ae942f', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:55:31 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-bfafe179-3e62-413c-805e-1e4166a06968 req-18d47848-35f5-4f1c-9ad7-413fda207481 tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:55:31 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-bfafe179-3e62-413c-805e-1e4166a06968 req-18d47848-35f5-4f1c-9ad7-413fda207481 tempest-TestInstancesWithCinderVolumes-1215805251 None] attachment_update completed successfully.
Sep 10 19:55:41 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:55:41 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:56:06 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-c00ca880-be74-44f4-90bf-1993d9818b17 req-9730c4a6-ffdb-4313-bb7d-430e851768eb tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:56:06 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-c00ca880-be74-44f4-90bf-1993d9818b17 req-9730c4a6-ffdb-4313-bb7d-430e851768eb tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:56:06 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-c00ca880-be74-44f4-90bf-1993d9818b17 req-9730c4a6-ffdb-4313-bb7d-430e851768eb tempest-TestInstancesWithCinderVolumes-1215805251 None] Terminate volume connection completed successfully.
Sep 10 19:56:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-c00ca880-be74-44f4-90bf-1993d9818b17 req-9730c4a6-ffdb-4313-bb7d-430e851768eb tempest-TestInstancesWithCinderVolumes-1215805251 None] Deleting attachment ed562316-f13b-43eb-b7b7-32adb9cc0fe5. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:56:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "cinder-db03b1cf-0428-409b-9584-1a1421c30d1d-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:56:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "cinder-db03b1cf-0428-409b-9584-1a1421c30d1d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:56:09 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:56:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "cinder-quobyte-db03b1cf-0428-409b-9584-1a1421c30d1d" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:56:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "cinder-quobyte-db03b1cf-0428-409b-9584-1a1421c30d1d" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:56:09 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee61ee4c-ece7-462a-a4ee-4f8f134bb6ec]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:56:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-db03b1cf-0428-409b-9584-1a1421c30d1d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:56:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-db03b1cf-0428-409b-9584-1a1421c30d1d" returned: 0 in 0.522s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:56:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-db03b1cf-0428-409b-9584-1a1421c30d1d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:56:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-db03b1cf-0428-409b-9584-1a1421c30d1d" returned: 0 in 0.126s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:56:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "cinder-quobyte-db03b1cf-0428-409b-9584-1a1421c30d1d" released by "delete_volume" :: held 0.822s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:56:10 devstack cinder-volume[82850]: WARNING cinder.quota [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1648084581-1187200514 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1648084581-1187200514, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:56:10 devstack cinder-volume[82850]: WARNING cinder.quota [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1648084581-1187200514 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1648084581-1187200514, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:56:11 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Created reservations ['2a5538e0-9e6e-4e56-b5f0-27d0b5966ff5', '0a870f46-b454-408b-9da9-e9bd82489afb', '4defbdb6-643a-476e-92bf-f817855e7a43', '07ed8214-16bf-45de-ba2d-1098f28a2a3d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:56:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:56:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:56:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:56:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:56:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:56:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:56:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.113s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:56:12 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:56:12 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Deleted volume successfully.
Sep 10 19:56:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0e5700f2-f2dd-43eb-8b68-0fd2b30efe28 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "cinder-db03b1cf-0428-409b-9584-1a1421c30d1d-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:56:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:56:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:56:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:56:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:56:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:56:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:56:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:56:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.117s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:56:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:56:22 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=4 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:56:22 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:56:38 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-08c8d99c-c330-4a6d-b1ad-6b3ae65e3071 req-cfc50938-a43f-4b64-9621-5923fbe31c9b tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:56:38 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-08c8d99c-c330-4a6d-b1ad-6b3ae65e3071 req-cfc50938-a43f-4b64-9621-5923fbe31c9b tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:56:38 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-08c8d99c-c330-4a6d-b1ad-6b3ae65e3071 req-cfc50938-a43f-4b64-9621-5923fbe31c9b tempest-TestInstancesWithCinderVolumes-1215805251 None] Terminate volume connection completed successfully.
Sep 10 19:56:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-08c8d99c-c330-4a6d-b1ad-6b3ae65e3071 req-cfc50938-a43f-4b64-9621-5923fbe31c9b tempest-TestInstancesWithCinderVolumes-1215805251 None] Deleting attachment 2ba11cb9-53d2-4c6d-92db-0e6fd9ae942f. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:56:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "cinder-38424d33-d214-443d-86f3-6ec4175ed2fe-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:56:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "cinder-38424d33-d214-443d-86f3-6ec4175ed2fe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:56:40 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:56:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "cinder-quobyte-38424d33-d214-443d-86f3-6ec4175ed2fe" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:56:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "cinder-quobyte-38424d33-d214-443d-86f3-6ec4175ed2fe" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:56:40 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dada6d16-ade9-4da3-b8a0-feb9a7799358]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:56:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-38424d33-d214-443d-86f3-6ec4175ed2fe {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:56:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-38424d33-d214-443d-86f3-6ec4175ed2fe" returned: 0 in 0.496s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:56:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-38424d33-d214-443d-86f3-6ec4175ed2fe {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:56:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-38424d33-d214-443d-86f3-6ec4175ed2fe" returned: 0 in 0.112s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:56:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "cinder-quobyte-38424d33-d214-443d-86f3-6ec4175ed2fe" released by "delete_volume" :: held 0.790s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:56:41 devstack cinder-volume[82850]: WARNING cinder.quota [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-531787799-1312433037 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-531787799-1312433037, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:56:41 devstack cinder-volume[82850]: WARNING cinder.quota [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-531787799-1312433037 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-531787799-1312433037, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:56:41 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Created reservations ['9e0cb2dd-6e07-4bd8-9562-3ae1a1c1efbb', '51ba5baf-ff33-4062-a413-a62269c9b8fe', '85ab2fab-acdf-4ccc-adc9-70e890f618b5', 'e5400987-a716-40cd-9202-c1346ae403c1'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:56:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:56:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.065s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:56:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:56:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:56:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:56:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:56:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.117s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:56:41 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:56:41 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Deleted volume successfully.
Sep 10 19:56:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-874b1ddc-1c05-4db2-a4bc-63f04abc4cb7 tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "cinder-38424d33-d214-443d-86f3-6ec4175ed2fe-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:56:49 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-00812c06-88c2-4420-b2ea-6aa115c0fbca req-0a3d5930-1209-40f5-8fcf-39e88b3abccd tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:56:49 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-00812c06-88c2-4420-b2ea-6aa115c0fbca req-0a3d5930-1209-40f5-8fcf-39e88b3abccd tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:56:49 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-00812c06-88c2-4420-b2ea-6aa115c0fbca req-0a3d5930-1209-40f5-8fcf-39e88b3abccd tempest-TestInstancesWithCinderVolumes-1215805251 None] Terminate volume connection completed successfully.
Sep 10 19:56:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-00812c06-88c2-4420-b2ea-6aa115c0fbca req-0a3d5930-1209-40f5-8fcf-39e88b3abccd tempest-TestInstancesWithCinderVolumes-1215805251 None] Deleting attachment ac680847-d458-41f7-b72a-dddce760aeb6. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:56:51 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=13,cinder:SELECT=6,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:56:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "cinder-32ad55b2-09b1-419c-9f60-298de9a05bec-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:56:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "cinder-32ad55b2-09b1-419c-9f60-298de9a05bec-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:56:52 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:56:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "cinder-quobyte-32ad55b2-09b1-419c-9f60-298de9a05bec" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:56:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "cinder-quobyte-32ad55b2-09b1-419c-9f60-298de9a05bec" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:56:52 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd1d907-b676-49e2-8663-8c0779f2e47f]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:56:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:56:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec" returned: 0 in 0.369s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:56:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:56:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec" returned: 1 in 0.364s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:56:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:56:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:56:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-32ad55b2-09b1-419c-9f60-298de9a05bec" returned: 0 in 0.077s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:56:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "cinder-quobyte-32ad55b2-09b1-419c-9f60-298de9a05bec" released by "delete_volume" :: held 1.065s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:56:53 devstack cinder-volume[82850]: WARNING cinder.quota [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1211973182-893940570 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1211973182-893940570, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:56:53 devstack cinder-volume[82850]: WARNING cinder.quota [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1211973182-893940570 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1211973182-893940570, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:56:53 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Created reservations ['8cdc4bdb-8828-4416-a480-9f26389a5d02', 'f80c07b6-3e7d-49cc-8d67-509cc891bcf7', '656065c5-d1d8-41e0-9efa-5fcaea676b2f', 'c5b9da57-79c9-49a2-852b-edc6c881a992'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:56:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:56:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:56:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:56:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:56:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:56:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:56:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.078s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:56:53 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:56:53 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Deleted volume successfully.
Sep 10 19:56:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7b45523b-cfb9-4fbb-a67f-77a340d5786f tempest-TestInstancesWithCinderVolumes-1215805251 None] Lock "cinder-32ad55b2-09b1-419c-9f60-298de9a05bec-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:57:03 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=12 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:57:04 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:57:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:57:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:57:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:57:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:57:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:57:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:57:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:57:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.096s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:57:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:57:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:57:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:57:58 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Flow 'volume_create_manager' (738b75a6-b471-44cb-9f00-9a34362b5e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf70f649-1bf0-449e-8a45-9bff4a363a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf70f649-1bf0-449e-8a45-9bff4a363a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1108301388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f710b252-7d12-4651-b7d8-5aedcf8aa866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0feddad801b74092aecb6f16e13bc1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:57:58Z,use_quota=True,user_id='2a3aa649df5843589a8ca8f4bd557ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65cc540-f5e6-4114-9ded-1f8590243273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65cc540-f5e6-4114-9ded-1f8590243273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856e2b75-acd3-4ee7-8a6a-9dff920186d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856e2b75-acd3-4ee7-8a6a-9dff920186d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f710b252-7d12-4651-b7d8-5aedcf8aa866', 'volume_name': 'volume-f710b252-7d12-4651-b7d8-5aedcf8aa866', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bf984c-23ad-4634-8100-1fe770a070ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bf984c-23ad-4634-8100-1fe770a070ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5422fa7-2a31-46e4-9c90-10fbed5fbb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:57:58 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Volume f710b252-7d12-4651-b7d8-5aedcf8aa866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f710b252-7d12-4651-b7d8-5aedcf8aa866', 'volume_size': 1}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1108301388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f710b252-7d12-4651-b7d8-5aedcf8aa866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0feddad801b74092aecb6f16e13bc1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:57:58Z,use_quota=True,user_id='2a3aa649df5843589a8ca8f4bd557ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Creating volume f710b252-7d12-4651-b7d8-5aedcf8aa866 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:57:58 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f710b252-7d12-4651-b7d8-5aedcf8aa866 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:57:58 devstack quobyte-client[82855]: System call of process 98442 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:57:58 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=134, name=volume-f710b252-7d12-4651-b7d8-5aedcf8aa866, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f710b252-7d12-4651-b7d8-5aedcf8aa866 1073741824" returned: 0 in 0.356s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f710b252-7d12-4651-b7d8-5aedcf8aa866 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f710b252-7d12-4651-b7d8-5aedcf8aa866" returned: 0 in 0.081s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] <== create_volume: return (505ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.516s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5422fa7-2a31-46e4-9c90-10fbed5fbb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f710b252-7d12-4651-b7d8-5aedcf8aa866', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5993b26-8fed-43c2-86d5-f6f9980b6188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:57:58 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Volume volume-f710b252-7d12-4651-b7d8-5aedcf8aa866 (f710b252-7d12-4651-b7d8-5aedcf8aa866): created successfully
Sep 10 19:57:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5993b26-8fed-43c2-86d5-f6f9980b6188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:57:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Flow 'volume_create_manager' (738b75a6-b471-44cb-9f00-9a34362b5e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:57:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-27a58404-ca48-4256-8e6b-7a413a234ce8 tempest-TestMinimumBasicScenario-531098439 None] Created volume successfully.
Sep 10 19:58:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-4a257e0e-bf5d-42f6-af15-485746586ee1 req-ab829cc0-91cd-4acf-b5e1-5c0398f8a7c7 tempest-TestMinimumBasicScenario-531098439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:58:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-4a257e0e-bf5d-42f6-af15-485746586ee1 req-ab829cc0-91cd-4acf-b5e1-5c0398f8a7c7 tempest-TestMinimumBasicScenario-531098439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:58:03 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b54d27a-22e9-4fd1-b9cb-137cd1deb386]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:58:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4a257e0e-bf5d-42f6-af15-485746586ee1 req-ab829cc0-91cd-4acf-b5e1-5c0398f8a7c7 tempest-TestMinimumBasicScenario-531098439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f710b252-7d12-4651-b7d8-5aedcf8aa866 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:58:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4a257e0e-bf5d-42f6-af15-485746586ee1 req-ab829cc0-91cd-4acf-b5e1-5c0398f8a7c7 tempest-TestMinimumBasicScenario-531098439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f710b252-7d12-4651-b7d8-5aedcf8aa866" returned: 0 in 0.390s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:58:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-4a257e0e-bf5d-42f6-af15-485746586ee1 req-ab829cc0-91cd-4acf-b5e1-5c0398f8a7c7 tempest-TestMinimumBasicScenario-531098439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.464s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:58:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-4a257e0e-bf5d-42f6-af15-485746586ee1 req-ab829cc0-91cd-4acf-b5e1-5c0398f8a7c7 tempest-TestMinimumBasicScenario-531098439 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-f710b252-7d12-4651-b7d8-5aedcf8aa866', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2ac8c15-f77e-4c53-bf51-8e5bb6f41ec2', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:58:03 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-4a257e0e-bf5d-42f6-af15-485746586ee1 req-ab829cc0-91cd-4acf-b5e1-5c0398f8a7c7 tempest-TestMinimumBasicScenario-531098439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:58:03 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-4a257e0e-bf5d-42f6-af15-485746586ee1 req-ab829cc0-91cd-4acf-b5e1-5c0398f8a7c7 tempest-TestMinimumBasicScenario-531098439 None] attachment_update completed successfully.
Sep 10 19:58:13 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=5 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:58:13 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:58:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:58:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:58:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:58:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:58:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:58:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:58:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:58:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.154s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:58:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:59:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:59:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:59:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:59:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:59:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:59:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:59:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:59:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.086s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:59:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:59:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:59:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:00:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 20:00:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:00:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:00:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:00:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:00:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:00:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:00:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.134s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:00:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:00:37 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-72f0f6ae-65d6-4958-bf08-51ce2434dcad req-b14cee46-f4db-475a-a78d-23edca837770 tempest-TestMinimumBasicScenario-531098439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:00:37 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-72f0f6ae-65d6-4958-bf08-51ce2434dcad req-b14cee46-f4db-475a-a78d-23edca837770 tempest-TestMinimumBasicScenario-531098439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:00:37 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-72f0f6ae-65d6-4958-bf08-51ce2434dcad req-b14cee46-f4db-475a-a78d-23edca837770 tempest-TestMinimumBasicScenario-531098439 None] Terminate volume connection completed successfully.
Sep 10 20:00:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-72f0f6ae-65d6-4958-bf08-51ce2434dcad req-b14cee46-f4db-475a-a78d-23edca837770 tempest-TestMinimumBasicScenario-531098439 None] Deleting attachment b2ac8c15-f77e-4c53-bf51-8e5bb6f41ec2. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 20:00:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Acquiring lock "cinder-f710b252-7d12-4651-b7d8-5aedcf8aa866-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:00:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Lock "cinder-f710b252-7d12-4651-b7d8-5aedcf8aa866-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:00:40 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:00:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Acquiring lock "cinder-quobyte-f710b252-7d12-4651-b7d8-5aedcf8aa866" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:00:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Lock "cinder-quobyte-f710b252-7d12-4651-b7d8-5aedcf8aa866" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:00:40 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0cc69e-1e98-4c11-9846-30a58e7e187f]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:00:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f710b252-7d12-4651-b7d8-5aedcf8aa866 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:00:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f710b252-7d12-4651-b7d8-5aedcf8aa866" returned: 0 in 0.420s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:00:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f710b252-7d12-4651-b7d8-5aedcf8aa866 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:00:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-f710b252-7d12-4651-b7d8-5aedcf8aa866" returned: 0 in 0.081s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:00:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Lock "cinder-quobyte-f710b252-7d12-4651-b7d8-5aedcf8aa866" released by "delete_volume" :: held 0.643s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:00:40 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Created reservations ['12454f78-1aa6-4bf1-bb35-fd972bfa696c', '566eb03b-a31b-407d-b846-a396c88ea463', '34f4a35b-d0ef-4abc-b9e4-444cdcd14806', '0aa91f3a-c4b5-4137-8871-a0df52ce8cad'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:00:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:00:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:00:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:00:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:00:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:00:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:00:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.094s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:00:41 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:00:41 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Deleted volume successfully.
Sep 10 20:00:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0068a73b-a52a-44ff-bb63-a861093ecbf7 tempest-TestMinimumBasicScenario-531098439 None] Lock "cinder-f710b252-7d12-4651-b7d8-5aedcf8aa866-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:00:50 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=15 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:00:51 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:01:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 20:01:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:01:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:01:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:01:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:01:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:01:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:01:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.151s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:01:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:01:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:01:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:02:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 20:02:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:02:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:02:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:02:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:02:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:02:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:02:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.099s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:02:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:02:54 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Flow 'volume_create_manager' (e0972982-6bdf-41d9-b775-04530f964dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51dba37-f5d3-43a4-8ee0-998d84183ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51dba37-f5d3-43a4-8ee0-998d84183ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1484198938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78cf5ad-b9cf-4890-bd37-ecff48586036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf329fe3e133468cb71a409002594f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:02:54Z,use_quota=True,user_id='e2aaa497f1d841c28f34ffba9640bf65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b33583-4215-44ca-a2e4-8b4ca66fdb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b33583-4215-44ca-a2e4-8b4ca66fdb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3135c997-737a-4e0e-bb33-e73a56914699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3135c997-737a-4e0e-bb33-e73a56914699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a78cf5ad-b9cf-4890-bd37-ecff48586036', 'volume_name': 'volume-a78cf5ad-b9cf-4890-bd37-ecff48586036', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2cc7ce-ff52-42c5-a58e-a361b986ccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2cc7ce-ff52-42c5-a58e-a361b986ccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b48333a-c9ff-4cca-96fb-c2a177d10297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:02:54 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Volume a78cf5ad-b9cf-4890-bd37-ecff48586036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a78cf5ad-b9cf-4890-bd37-ecff48586036', 'volume_size': 1}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1484198938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78cf5ad-b9cf-4890-bd37-ecff48586036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf329fe3e133468cb71a409002594f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:02:54Z,use_quota=True,user_id='e2aaa497f1d841c28f34ffba9640bf65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Creating volume a78cf5ad-b9cf-4890-bd37-ecff48586036 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:02:54 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:02:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a78cf5ad-b9cf-4890-bd37-ecff48586036 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:02:54 devstack quobyte-client[82855]: System call of process 99595 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:02:54 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=135, name=volume-a78cf5ad-b9cf-4890-bd37-ecff48586036, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:02:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a78cf5ad-b9cf-4890-bd37-ecff48586036 1073741824" returned: 0 in 0.395s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:02:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a78cf5ad-b9cf-4890-bd37-ecff48586036 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:02:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a78cf5ad-b9cf-4890-bd37-ecff48586036" returned: 0 in 0.083s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:02:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] <== create_volume: return (539ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:02:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.549s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:02:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b48333a-c9ff-4cca-96fb-c2a177d10297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a78cf5ad-b9cf-4890-bd37-ecff48586036', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:02:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c04a482-0284-4cc6-b030-272028e1710e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:02:55 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Volume volume-a78cf5ad-b9cf-4890-bd37-ecff48586036 (a78cf5ad-b9cf-4890-bd37-ecff48586036): created successfully
Sep 10 20:02:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c04a482-0284-4cc6-b030-272028e1710e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:02:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Flow 'volume_create_manager' (e0972982-6bdf-41d9-b775-04530f964dbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:02:55 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6ca64fa3-257c-41b5-bb31-4852aa0697d8 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Created volume successfully.
Sep 10 20:03:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-b381f235-7eed-406b-b09f-09161b9dc47f req-33c7e05b-a461-41cd-9ec8-ae4f8e42d091 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:03:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-b381f235-7eed-406b-b09f-09161b9dc47f req-33c7e05b-a461-41cd-9ec8-ae4f8e42d091 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:03:00 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[83da47bc-92fc-447e-bd22-81757fab2417]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:03:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-b381f235-7eed-406b-b09f-09161b9dc47f req-33c7e05b-a461-41cd-9ec8-ae4f8e42d091 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a78cf5ad-b9cf-4890-bd37-ecff48586036 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:03:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-b381f235-7eed-406b-b09f-09161b9dc47f req-33c7e05b-a461-41cd-9ec8-ae4f8e42d091 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a78cf5ad-b9cf-4890-bd37-ecff48586036" returned: 0 in 0.372s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:03:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-b381f235-7eed-406b-b09f-09161b9dc47f req-33c7e05b-a461-41cd-9ec8-ae4f8e42d091 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.429s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:03:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-b381f235-7eed-406b-b09f-09161b9dc47f req-33c7e05b-a461-41cd-9ec8-ae4f8e42d091 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a', 'name': 'volume-a78cf5ad-b9cf-4890-bd37-ecff48586036', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9eddf5a0-97c7-486a-ab23-01f8174e0a56', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 20:03:01 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-b381f235-7eed-406b-b09f-09161b9dc47f req-33c7e05b-a461-41cd-9ec8-ae4f8e42d091 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:03:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-b381f235-7eed-406b-b09f-09161b9dc47f req-33c7e05b-a461-41cd-9ec8-ae4f8e42d091 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] attachment_update completed successfully.
Sep 10 20:03:11 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:03:11 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:03:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 20:03:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:03:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:03:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:03:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:03:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:03:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:03:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.082s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:03:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:03:30 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-78f01f7f-9fd2-4573-b99c-b702b087c175 req-78701256-ead4-47c5-bf88-6a4b771120e0 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:03:30 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [req-78f01f7f-9fd2-4573-b99c-b702b087c175 req-78701256-ead4-47c5-bf88-6a4b771120e0 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:03:30 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-78f01f7f-9fd2-4573-b99c-b702b087c175 req-78701256-ead4-47c5-bf88-6a4b771120e0 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Terminate volume connection completed successfully.
Sep 10 20:03:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-78f01f7f-9fd2-4573-b99c-b702b087c175 req-78701256-ead4-47c5-bf88-6a4b771120e0 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Deleting attachment 9eddf5a0-97c7-486a-ab23-01f8174e0a56. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 20:03:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Acquiring lock "cinder-a78cf5ad-b9cf-4890-bd37-ecff48586036-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:03:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Lock "cinder-a78cf5ad-b9cf-4890-bd37-ecff48586036-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:03:33 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:03:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Acquiring lock "cinder-quobyte-a78cf5ad-b9cf-4890-bd37-ecff48586036" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:03:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Lock "cinder-quobyte-a78cf5ad-b9cf-4890-bd37-ecff48586036" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:03:33 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc248dfa-416b-4a49-9988-64a2de8db8c0]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:03:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a78cf5ad-b9cf-4890-bd37-ecff48586036 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:03:33 devstack quobyte-client[82855]: System call of process 100077 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:03:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a78cf5ad-b9cf-4890-bd37-ecff48586036" returned: 0 in 0.446s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:03:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a78cf5ad-b9cf-4890-bd37-ecff48586036 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:03:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a78cf5ad-b9cf-4890-bd37-ecff48586036" returned: 0 in 0.082s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:03:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Lock "cinder-quobyte-a78cf5ad-b9cf-4890-bd37-ecff48586036" released by "delete_volume" :: held 0.679s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:03:34 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Created reservations ['18a8b8e5-0fc2-4766-a16f-7795505107c4', '95882b53-9c16-4a7d-945f-f0b15646412e', '3b3b4c4e-a49a-42d4-9338-d7b8db656ff5', '4bd2ee95-eda0-4ca1-bc35-2da71cf3847a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:03:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:03:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:03:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:03:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:03:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:03:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:03:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.086s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:03:34 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:03:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Deleted volume successfully.
Sep 10 20:03:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2730afbf-0832-46ca-8ec7-25cf4544bbe1 tempest-TestServerVolumeAttachScenarioOldVersion-882066339 None] Lock "cinder-a78cf5ad-b9cf-4890-bd37-ecff48586036-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:03:44 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:03:44 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=7,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:03:59 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Flow 'volume_create_manager' (a1c3bdeb-1f6e-4300-ad4d-27bb0f929009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871b3016-9b31-4399-92b0-6de697118ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871b3016-9b31-4399-92b0-6de697118ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-480728284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeda58f9-15f2-452b-a1c1-8bffeefca031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badb06f47bce49a7aa36e31a9556562c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:04:00Z,use_quota=True,user_id='d2b36dc12ba747128eadefd25809bed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7635822-2a45-451a-b131-8b13090373f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7635822-2a45-451a-b131-8b13090373f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38cdb3bd-0b99-4aaa-950b-b3235c748d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38cdb3bd-0b99-4aaa-950b-b3235c748d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeda58f9-15f2-452b-a1c1-8bffeefca031', 'volume_name': 'volume-eeda58f9-15f2-452b-a1c1-8bffeefca031', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479d209b-9d4c-4d62-ba37-c0f7a093025d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479d209b-9d4c-4d62-ba37-c0f7a093025d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275a5910-bdb4-4266-8a4e-687ca8da9d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:03:59 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume eeda58f9-15f2-452b-a1c1-8bffeefca031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeda58f9-15f2-452b-a1c1-8bffeefca031', 'volume_size': 1}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-480728284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeda58f9-15f2-452b-a1c1-8bffeefca031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badb06f47bce49a7aa36e31a9556562c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:04:00Z,use_quota=True,user_id='d2b36dc12ba747128eadefd25809bed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Creating volume eeda58f9-15f2-452b-a1c1-8bffeefca031 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:03:59 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:03:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-eeda58f9-15f2-452b-a1c1-8bffeefca031 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:03:59 devstack quobyte-client[82855]: System call of process 100146 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:03:59 devstack quobyte-client[82855]: System call of process 100146 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:03:59 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=136, name=volume-eeda58f9-15f2-452b-a1c1-8bffeefca031, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:04:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-eeda58f9-15f2-452b-a1c1-8bffeefca031 1073741824" returned: 0 in 0.329s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-eeda58f9-15f2-452b-a1c1-8bffeefca031 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-eeda58f9-15f2-452b-a1c1-8bffeefca031" returned: 0 in 0.079s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] <== create_volume: return (465ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:04:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.475s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275a5910-bdb4-4266-8a4e-687ca8da9d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeda58f9-15f2-452b-a1c1-8bffeefca031', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bfe3fb-0d33-4252-8e1f-303c58a9a294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:00 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume volume-eeda58f9-15f2-452b-a1c1-8bffeefca031 (eeda58f9-15f2-452b-a1c1-8bffeefca031): created successfully
Sep 10 20:04:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bfe3fb-0d33-4252-8e1f-303c58a9a294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Flow 'volume_create_manager' (a1c3bdeb-1f6e-4300-ad4d-27bb0f929009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:04:00 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-878bf28f-fee5-44a6-87fa-ff05a551ba57 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Created volume successfully.
Sep 10 20:04:01 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Flow 'volume_create_manager' (683f1b9e-ab31-4799-8743-7f4529804787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f4240b-acc5-45ef-aa59-fdac3d6b774c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f4240b-acc5-45ef-aa59-fdac3d6b774c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-929788682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53df8bfe-c835-4862-9e70-3a97896fe71f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badb06f47bce49a7aa36e31a9556562c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:04:01Z,use_quota=True,user_id='d2b36dc12ba747128eadefd25809bed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e801f5c6-ef31-4750-bc3d-328c2d3f5b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e801f5c6-ef31-4750-bc3d-328c2d3f5b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60861686-07f2-4654-bd6b-bbb3400e95b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60861686-07f2-4654-bd6b-bbb3400e95b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53df8bfe-c835-4862-9e70-3a97896fe71f', 'volume_name': 'volume-53df8bfe-c835-4862-9e70-3a97896fe71f', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4675a6c-e29e-45fc-a614-1086e8f062d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4675a6c-e29e-45fc-a614-1086e8f062d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9579e193-7ee9-4fe1-8bad-5f4f20a06de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:01 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume 53df8bfe-c835-4862-9e70-3a97896fe71f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53df8bfe-c835-4862-9e70-3a97896fe71f', 'volume_size': 1}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-929788682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53df8bfe-c835-4862-9e70-3a97896fe71f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badb06f47bce49a7aa36e31a9556562c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:04:01Z,use_quota=True,user_id='d2b36dc12ba747128eadefd25809bed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Creating volume 53df8bfe-c835-4862-9e70-3a97896fe71f {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:04:01 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-53df8bfe-c835-4862-9e70-3a97896fe71f 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:01 devstack quobyte-client[82855]: System call of process 100150 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:04:01 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=137, name=volume-53df8bfe-c835-4862-9e70-3a97896fe71f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-53df8bfe-c835-4862-9e70-3a97896fe71f 1073741824" returned: 0 in 0.487s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-53df8bfe-c835-4862-9e70-3a97896fe71f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-53df8bfe-c835-4862-9e70-3a97896fe71f" returned: 0 in 0.229s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] <== create_volume: return (785ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:02 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Flow 'volume_create_manager' (87327aee-f28d-40f2-889d-06a123be3c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b49376c-503a-4c1b-ad47-b678dac84799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9579e193-7ee9-4fe1-8bad-5f4f20a06de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53df8bfe-c835-4862-9e70-3a97896fe71f', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e13d75-ac7d-406a-a892-4bfca673f890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b49376c-503a-4c1b-ad47-b678dac84799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1649189639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139bc5dc-ed17-4d7b-b60f-04bda4710d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badb06f47bce49a7aa36e31a9556562c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:04:01Z,use_quota=True,user_id='d2b36dc12ba747128eadefd25809bed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e2c47f-6cdc-4f9e-9b23-d4c9a15ba05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e2c47f-6cdc-4f9e-9b23-d4c9a15ba05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401778b4-c470-41bb-9ae3-0cd7ad6182e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401778b4-c470-41bb-9ae3-0cd7ad6182e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '139bc5dc-ed17-4d7b-b60f-04bda4710d5b', 'volume_name': 'volume-139bc5dc-ed17-4d7b-b60f-04bda4710d5b', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3bcd7e-e3e2-42d9-be01-0789be89248d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3bcd7e-e3e2-42d9-be01-0789be89248d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c92b34-5fce-44e7-819f-883d31cd3520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:02 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume 139bc5dc-ed17-4d7b-b60f-04bda4710d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-139bc5dc-ed17-4d7b-b60f-04bda4710d5b', 'volume_size': 1}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1649189639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139bc5dc-ed17-4d7b-b60f-04bda4710d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badb06f47bce49a7aa36e31a9556562c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:04:01Z,use_quota=True,user_id='d2b36dc12ba747128eadefd25809bed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Creating volume 139bc5dc-ed17-4d7b-b60f-04bda4710d5b {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:04:02 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-139bc5dc-ed17-4d7b-b60f-04bda4710d5b 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:02 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=138, name=volume-139bc5dc-ed17-4d7b-b60f-04bda4710d5b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:04:02 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume volume-53df8bfe-c835-4862-9e70-3a97896fe71f (53df8bfe-c835-4862-9e70-3a97896fe71f): created successfully
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e13d75-ac7d-406a-a892-4bfca673f890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Flow 'volume_create_manager' (683f1b9e-ab31-4799-8743-7f4529804787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:04:03 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Flow 'volume_create_manager' (e3d07ef9-b974-4ec1-a216-2a4c8d7331ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2840c9c-f408-4f98-ac98-4e30965c6d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:03 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-42db694a-b85c-4145-8df4-a8f194322325 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Created volume successfully.
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-139bc5dc-ed17-4d7b-b60f-04bda4710d5b 1073741824" returned: 0 in 0.929s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-139bc5dc-ed17-4d7b-b60f-04bda4710d5b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:03 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Flow 'volume_create_manager' (8c1f8157-78cf-4d7b-9c70-828da6fd7a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e53747-9700-4915-8989-bef19317bf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2840c9c-f408-4f98-ac98-4e30965c6d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519237897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ea9eb8-2f0d-486d-ab49-488c413eb920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badb06f47bce49a7aa36e31a9556562c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:04:02Z,use_quota=True,user_id='d2b36dc12ba747128eadefd25809bed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81d7073-f29c-4f2a-873f-beafb5bced63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81d7073-f29c-4f2a-873f-beafb5bced63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4642ed32-a285-4156-b977-231dc56ba16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4642ed32-a285-4156-b977-231dc56ba16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23ea9eb8-2f0d-486d-ab49-488c413eb920', 'volume_name': 'volume-23ea9eb8-2f0d-486d-ab49-488c413eb920', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fb2abc-5e2e-45a6-b124-b0969c24bdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fb2abc-5e2e-45a6-b124-b0969c24bdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c793b793-c135-44d4-8844-8a47d3940bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:03 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume 23ea9eb8-2f0d-486d-ab49-488c413eb920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23ea9eb8-2f0d-486d-ab49-488c413eb920', 'volume_size': 1}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e53747-9700-4915-8989-bef19317bf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1934977673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df85a49-5e70-4b71-9ef7-2d291443ad57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badb06f47bce49a7aa36e31a9556562c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:04:03Z,use_quota=True,user_id='d2b36dc12ba747128eadefd25809bed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e27cbd-65fe-486b-8742-c550bfd5ea2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e27cbd-65fe-486b-8742-c550bfd5ea2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa7e8ee-fb27-43b7-8502-82a61831fe93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa7e8ee-fb27-43b7-8502-82a61831fe93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0df85a49-5e70-4b71-9ef7-2d291443ad57', 'volume_name': 'volume-0df85a49-5e70-4b71-9ef7-2d291443ad57', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226e1ac8-5dad-4b37-b4b0-1138839eef56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226e1ac8-5dad-4b37-b4b0-1138839eef56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb400a4-1b18-4e51-8af2-b6de158865a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:03 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume 0df85a49-5e70-4b71-9ef7-2d291443ad57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0df85a49-5e70-4b71-9ef7-2d291443ad57', 'volume_size': 1}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-139bc5dc-ed17-4d7b-b60f-04bda4710d5b" returned: 0 in 0.556s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] <== create_volume: return (1504ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.171s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519237897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ea9eb8-2f0d-486d-ab49-488c413eb920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badb06f47bce49a7aa36e31a9556562c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:04:02Z,use_quota=True,user_id='d2b36dc12ba747128eadefd25809bed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Creating volume 23ea9eb8-2f0d-486d-ab49-488c413eb920 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:04:03 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:04:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-23ea9eb8-2f0d-486d-ab49-488c413eb920 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:04 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=139, name=volume-23ea9eb8-2f0d-486d-ab49-488c413eb920, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c92b34-5fce-44e7-819f-883d31cd3520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-139bc5dc-ed17-4d7b-b60f-04bda4710d5b', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156917c2-63d6-4fa0-869d-4ec242a02d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-23ea9eb8-2f0d-486d-ab49-488c413eb920 1073741824" returned: 0 in 0.432s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-23ea9eb8-2f0d-486d-ab49-488c413eb920 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:04 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Flow 'volume_create_manager' (34d08e3b-94d3-4edb-8a78-05324382b823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad4b497e-c77d-4873-aab5-88f24fbb7318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:04 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume volume-139bc5dc-ed17-4d7b-b60f-04bda4710d5b (139bc5dc-ed17-4d7b-b60f-04bda4710d5b): created successfully
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156917c2-63d6-4fa0-869d-4ec242a02d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Flow 'volume_create_manager' (87327aee-f28d-40f2-889d-06a123be3c2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad4b497e-c77d-4873-aab5-88f24fbb7318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1019659498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ab1c5d-8b16-44fb-ae6b-aec89051dd7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badb06f47bce49a7aa36e31a9556562c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:04:03Z,use_quota=True,user_id='d2b36dc12ba747128eadefd25809bed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928a63fe-e25e-4a41-8a72-c2dea399e315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928a63fe-e25e-4a41-8a72-c2dea399e315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a8d89d-5650-481d-beed-34971675ab6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a8d89d-5650-481d-beed-34971675ab6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02ab1c5d-8b16-44fb-ae6b-aec89051dd7c', 'volume_name': 'volume-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c61d4a-f682-4d3d-b0b2-0a6742aa84dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c61d4a-f682-4d3d-b0b2-0a6742aa84dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca8cb02-8f06-4164-81f7-ad7c91097c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:04 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume 02ab1c5d-8b16-44fb-ae6b-aec89051dd7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c', 'volume_size': 1}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-23ea9eb8-2f0d-486d-ab49-488c413eb920" returned: 0 in 0.510s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] <== create_volume: return (962ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.029s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1934977673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df85a49-5e70-4b71-9ef7-2d291443ad57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badb06f47bce49a7aa36e31a9556562c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:04:03Z,use_quota=True,user_id='d2b36dc12ba747128eadefd25809bed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Creating volume 0df85a49-5e70-4b71-9ef7-2d291443ad57 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:04:04 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:04:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0df85a49-5e70-4b71-9ef7-2d291443ad57 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:05 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=140, name=volume-0df85a49-5e70-4b71-9ef7-2d291443ad57, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:04:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-734054dc-5f1a-434f-a78d-ded5d1db88f8 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Created volume successfully.
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c793b793-c135-44d4-8844-8a47d3940bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23ea9eb8-2f0d-486d-ab49-488c413eb920', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f1d08c-3775-4751-8393-d2913634dcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0df85a49-5e70-4b71-9ef7-2d291443ad57 1073741824" returned: 0 in 0.423s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0df85a49-5e70-4b71-9ef7-2d291443ad57 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:05 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume volume-23ea9eb8-2f0d-486d-ab49-488c413eb920 (23ea9eb8-2f0d-486d-ab49-488c413eb920): created successfully
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f1d08c-3775-4751-8393-d2913634dcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Flow 'volume_create_manager' (e3d07ef9-b974-4ec1-a216-2a4c8d7331ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0df85a49-5e70-4b71-9ef7-2d291443ad57" returned: 0 in 0.323s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] <== create_volume: return (768ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1019659498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ab1c5d-8b16-44fb-ae6b-aec89051dd7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badb06f47bce49a7aa36e31a9556562c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:04:03Z,use_quota=True,user_id='d2b36dc12ba747128eadefd25809bed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Creating volume 02ab1c5d-8b16-44fb-ae6b-aec89051dd7c {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:04:05 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:04:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:05 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=141, name=volume-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:04:06 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fdf1e70a-b908-4237-a710-545dce9d2d0f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Created volume successfully.
Sep 10 20:04:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb400a4-1b18-4e51-8af2-b6de158865a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df85a49-5e70-4b71-9ef7-2d291443ad57', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7145ecd8-1a91-4b57-b77c-bdfe8477f061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c 1073741824" returned: 0 in 0.490s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:06 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume volume-0df85a49-5e70-4b71-9ef7-2d291443ad57 (0df85a49-5e70-4b71-9ef7-2d291443ad57): created successfully
Sep 10 20:04:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7145ecd8-1a91-4b57-b77c-bdfe8477f061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Flow 'volume_create_manager' (8c1f8157-78cf-4d7b-9c70-828da6fd7a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:04:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c" returned: 0 in 0.303s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] <== create_volume: return (816ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:04:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:06 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d17773d9-69a6-41b7-ab21-1b749a6ffdee tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Created volume successfully.
Sep 10 20:04:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca8cb02-8f06-4164-81f7-ad7c91097c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917ee7f8-828f-44ed-afe9-d14dd2c32c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:06 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume volume-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c (02ab1c5d-8b16-44fb-ae6b-aec89051dd7c): created successfully
Sep 10 20:04:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917ee7f8-828f-44ed-afe9-d14dd2c32c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Flow 'volume_create_manager' (34d08e3b-94d3-4edb-8a78-05324382b823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:04:06 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3e6efda8-2abe-4c8c-bccf-195da54982ca tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Created volume successfully.
Sep 10 20:04:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "cinder-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:04:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:04:07 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:04:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "cinder-quobyte-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:04:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-quobyte-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:04:07 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1b87b0-6fc4-402a-b66e-fbd9563777e8]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:04:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c" returned: 0 in 0.374s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c" returned: 0 in 0.119s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-quobyte-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c" released by "delete_volume" :: held 0.639s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:04:08 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Created reservations ['c593e8f6-908d-4c40-948e-2a2a08adcc04', '754807a8-412c-4f79-92d8-35137b4270fd', '5ae29964-d718-4eb4-95b9-9f08327d830b', 'aedd84ba-7dd2-4ee4-b7a1-afe4c57f6d3a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:04:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:04:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:04:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.103s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:08 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:04:08 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Deleted volume successfully.
Sep 10 20:04:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a91c0762-43a7-49cf-a030-4a822a4f4eae tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-02ab1c5d-8b16-44fb-ae6b-aec89051dd7c-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:04:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "cinder-0df85a49-5e70-4b71-9ef7-2d291443ad57-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:04:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-0df85a49-5e70-4b71-9ef7-2d291443ad57-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:04:09 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:04:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "cinder-quobyte-0df85a49-5e70-4b71-9ef7-2d291443ad57" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:04:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-quobyte-0df85a49-5e70-4b71-9ef7-2d291443ad57" acquired by "delete_volume" :: waited 0.020s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:04:09 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab761706-49d2-4d81-ba0e-89b65d3b4f08]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:04:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0df85a49-5e70-4b71-9ef7-2d291443ad57 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0df85a49-5e70-4b71-9ef7-2d291443ad57" returned: 0 in 0.401s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0df85a49-5e70-4b71-9ef7-2d291443ad57 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0df85a49-5e70-4b71-9ef7-2d291443ad57" returned: 0 in 0.085s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-quobyte-0df85a49-5e70-4b71-9ef7-2d291443ad57" released by "delete_volume" :: held 0.658s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:04:10 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Created reservations ['3fe780ba-5551-4305-8f5d-e0cbeb0ba5c6', 'f8ae84af-9edf-41c9-b05c-387b8ec92d4b', 'a410d76c-527d-420e-a5b1-a9fbba09ab0e', '7b90d486-5457-40ef-baec-a603777eb00e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:04:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:04:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:04:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.083s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:10 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:04:10 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Deleted volume successfully.
Sep 10 20:04:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0c55afcc-6a8d-4556-b054-58326cbf9e1f tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-0df85a49-5e70-4b71-9ef7-2d291443ad57-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:04:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "cinder-23ea9eb8-2f0d-486d-ab49-488c413eb920-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:04:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-23ea9eb8-2f0d-486d-ab49-488c413eb920-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:04:11 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:04:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "cinder-quobyte-23ea9eb8-2f0d-486d-ab49-488c413eb920" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:04:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-quobyte-23ea9eb8-2f0d-486d-ab49-488c413eb920" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:04:11 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a49406c-3301-4a8d-8846-9fd8812b7f76]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:04:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-23ea9eb8-2f0d-486d-ab49-488c413eb920 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-23ea9eb8-2f0d-486d-ab49-488c413eb920" returned: 0 in 0.385s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-23ea9eb8-2f0d-486d-ab49-488c413eb920 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-23ea9eb8-2f0d-486d-ab49-488c413eb920" returned: 0 in 0.115s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-quobyte-23ea9eb8-2f0d-486d-ab49-488c413eb920" released by "delete_volume" :: held 0.638s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:04:12 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Created reservations ['7a9a355c-5d58-4b60-9cdf-227507df0f06', '2842bd30-8a9e-4c9d-8160-d5934116d143', '7c63e1d0-368c-46b0-aeb6-3f552d62e6f9', '40e353bc-f07a-41eb-87c6-30c8adb6c59d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:04:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:04:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:04:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.107s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:13 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:04:13 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Deleted volume successfully.
Sep 10 20:04:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8669f48b-9988-4a99-92b5-2da2af446590 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-23ea9eb8-2f0d-486d-ab49-488c413eb920-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "cinder-139bc5dc-ed17-4d7b-b60f-04bda4710d5b-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-139bc5dc-ed17-4d7b-b60f-04bda4710d5b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:04:14 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "cinder-quobyte-139bc5dc-ed17-4d7b-b60f-04bda4710d5b" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-quobyte-139bc5dc-ed17-4d7b-b60f-04bda4710d5b" acquired by "delete_volume" :: waited 0.031s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37e5bf9-c4ea-40c2-9f30-b3d67d62040a]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-139bc5dc-ed17-4d7b-b60f-04bda4710d5b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-139bc5dc-ed17-4d7b-b60f-04bda4710d5b" returned: 0 in 0.490s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-139bc5dc-ed17-4d7b-b60f-04bda4710d5b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.221s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-139bc5dc-ed17-4d7b-b60f-04bda4710d5b" returned: 0 in 0.179s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-quobyte-139bc5dc-ed17-4d7b-b60f-04bda4710d5b" released by "delete_volume" :: held 0.784s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:04:15 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Created reservations ['5ce70b14-449b-463a-8ab7-181a9269e760', 'b6133083-6e18-4d56-ab81-b0135cbcd806', 'a39fdc01-7f23-4354-8e80-7c75a1b1cb95', '5e8ad75d-6b38-4d2e-94ef-04803c56881e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:04:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:04:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:04:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.087s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:15 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:04:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Deleted volume successfully.
Sep 10 20:04:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2357e968-839a-4680-8f3d-f97977a97157 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-139bc5dc-ed17-4d7b-b60f-04bda4710d5b-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:04:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "cinder-53df8bfe-c835-4862-9e70-3a97896fe71f-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:04:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-53df8bfe-c835-4862-9e70-3a97896fe71f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:04:16 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:04:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "cinder-quobyte-53df8bfe-c835-4862-9e70-3a97896fe71f" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:04:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-quobyte-53df8bfe-c835-4862-9e70-3a97896fe71f" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:04:16 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bf558b-a7bb-488a-90cc-23e62d4168d6]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:04:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-53df8bfe-c835-4862-9e70-3a97896fe71f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-53df8bfe-c835-4862-9e70-3a97896fe71f" returned: 0 in 0.404s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-53df8bfe-c835-4862-9e70-3a97896fe71f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-53df8bfe-c835-4862-9e70-3a97896fe71f" returned: 0 in 0.111s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-quobyte-53df8bfe-c835-4862-9e70-3a97896fe71f" released by "delete_volume" :: held 0.660s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:04:17 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Created reservations ['12db3a0a-f94d-4172-99d5-d60ca030a6e0', '9f4fcdd2-c53b-4cc1-a683-0eab9868984a', '9a90c409-d0db-4aab-ac7a-d9a9e66f7e84', '398a20cd-b42b-44a7-9573-6f4b0d1605fe'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:04:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:04:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:04:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.122s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:17 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:04:17 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Deleted volume successfully.
Sep 10 20:04:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9f012f74-3c29-4c1f-a601-d868dad0ea81 tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-53df8bfe-c835-4862-9e70-3a97896fe71f-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:04:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "cinder-eeda58f9-15f2-452b-a1c1-8bffeefca031-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:04:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-eeda58f9-15f2-452b-a1c1-8bffeefca031-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:04:19 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:04:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "cinder-quobyte-eeda58f9-15f2-452b-a1c1-8bffeefca031" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:04:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-quobyte-eeda58f9-15f2-452b-a1c1-8bffeefca031" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:04:19 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0e237e-c16c-40fd-8b02-f2dcf000862c]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:04:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-eeda58f9-15f2-452b-a1c1-8bffeefca031 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-eeda58f9-15f2-452b-a1c1-8bffeefca031" returned: 0 in 0.423s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-eeda58f9-15f2-452b-a1c1-8bffeefca031 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-eeda58f9-15f2-452b-a1c1-8bffeefca031" returned: 0 in 0.128s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-quobyte-eeda58f9-15f2-452b-a1c1-8bffeefca031" released by "delete_volume" :: held 0.704s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:04:19 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Created reservations ['fa460c64-06c6-479a-ab96-7ee3710a9754', '2407365d-48c5-427f-8a1c-58ec20cf8376', '688f7d8d-4252-41a5-8aba-ce16188be3ca', '99eaa518-31e0-45ba-9a17-b737d3b54670'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:04:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:04:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:04:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.088s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:20 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:04:20 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Deleted volume successfully.
Sep 10 20:04:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-98cccc43-6790-42d4-adfb-43e761e9aaea tempest-CreateVolumesFromSourceVolumeTest-1653176617 None] Lock "cinder-eeda58f9-15f2-452b-a1c1-8bffeefca031-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:04:30 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=49,cinder:SELECT=34,cinder:DELETE=8,cinder:INSERT=13 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:04:30 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=38,cinder:UPDATE=71,cinder:DELETE=4,cinder:INSERT=11 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:04:46 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Flow 'volume_create_manager' (dfd73ef3-cb99-4fe7-a5f7-55e491c21425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ca7e3e-59ed-4a16-a890-11b53249fca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ca7e3e-59ed-4a16-a890-11b53249fca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1432050347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8202e4-c9a0-4e99-9c81-e79e96737cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d546de4e6b045228da3cddb631d84a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:04:47Z,use_quota=True,user_id='8006cdf0d42e4b5ca36d08c478103966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155809eb-dd98-45bc-a918-e11d167dcef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155809eb-dd98-45bc-a918-e11d167dcef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4942eb51-5c4d-4e52-ad1d-eaef69f743ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4942eb51-5c4d-4e52-ad1d-eaef69f743ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d8202e4-c9a0-4e99-9c81-e79e96737cf9', 'volume_name': 'volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c484e5-5484-4905-8bd5-af411472d60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c484e5-5484-4905-8bd5-af411472d60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79aff243-7c51-4917-8f05-8415f7b98c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:46 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Volume 9d8202e4-c9a0-4e99-9c81-e79e96737cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9', 'volume_size': 1}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1432050347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8202e4-c9a0-4e99-9c81-e79e96737cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d546de4e6b045228da3cddb631d84a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:04:47Z,use_quota=True,user_id='8006cdf0d42e4b5ca36d08c478103966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Creating volume 9d8202e4-c9a0-4e99-9c81-e79e96737cf9 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:04:46 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:04:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:46 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=142, name=volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:04:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 1073741824" returned: 0 in 0.333s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9" returned: 0 in 0.083s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] <== create_volume: return (477ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:04:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.488s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79aff243-7c51-4917-8f05-8415f7b98c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f539c0e-96e3-41eb-b2a3-0f8e443db014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:47 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Volume volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 (9d8202e4-c9a0-4e99-9c81-e79e96737cf9): created successfully
Sep 10 20:04:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f539c0e-96e3-41eb-b2a3-0f8e443db014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Flow 'volume_create_manager' (dfd73ef3-cb99-4fe7-a5f7-55e491c21425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:04:47 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ef72e291-5de5-48eb-8863-09b7c823f94f tempest-SnapshotDependencyTests-1269470879 None] Created volume successfully.
Sep 10 20:04:49 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:04:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] Creating offline snapshot 175195f7-d98e-426f-baef-819cd7a8b2d9 of volume 9d8202e4-c9a0-4e99-9c81-e79e96737cf9 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 20:04:49 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e17aa1-83ec-47ff-8681-9347da7329e4]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:04:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9" returned: 0 in 0.393s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:49 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=143, name=volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:04:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9 1G" returned: 0 in 0.242s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] CMD "qemu-img rebase -u -b volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9" returned: 0 in 0.127s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 20:04:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9" returned: 0 in 0.089s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 20:04:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9" returned: 0 in 0.080s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.info" returned: 0 in 0.099s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 20:04:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.info" returned: 0 in 0.079s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.414s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:50 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0c9f8c3e-b2a0-493e-a22c-9a3e0a906631 tempest-SnapshotDependencyTests-1269470879 None] Create snapshot completed successfully
Sep 10 20:04:52 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Flow 'volume_create_manager' (06f16cb9-e952-49ab-869b-ee065a7c0c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778bb051-50db-410b-9eab-222c28ee1985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778bb051-50db-410b-9eab-222c28ee1985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed175302-58cb-42ed-b575-e9f14db53253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d546de4e6b045228da3cddb631d84a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=175195f7-d98e-426f-baef-819cd7a8b2d9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:04:53Z,use_quota=True,user_id='8006cdf0d42e4b5ca36d08c478103966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f4924d-14da-42c1-8f99-cb7a4d913a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f4924d-14da-42c1-8f99-cb7a4d913a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531a5038-1414-4ef2-be90-48d2c84aae4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531a5038-1414-4ef2-be90-48d2c84aae4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ed175302-58cb-42ed-b575-e9f14db53253', 'volume_name': 'volume-ed175302-58cb-42ed-b575-e9f14db53253', 'volume_size': 1, 'snapshot_id': '175195f7-d98e-426f-baef-819cd7a8b2d9'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a27ebc9-552d-4395-909f-a5f5469d612b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a27ebc9-552d-4395-909f-a5f5469d612b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca5a9af-cd8b-4855-a705-0198b4c9b49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:04:52 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Volume ed175302-58cb-42ed-b575-e9f14db53253: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ed175302-58cb-42ed-b575-e9f14db53253', 'volume_size': 1, 'snapshot_id': '175195f7-d98e-426f-baef-819cd7a8b2d9'}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "cinder-quobyte-175195f7-d98e-426f-baef-819cd7a8b2d9-ed175302-58cb-42ed-b575-e9f14db53253" by "_create_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-quobyte-175195f7-d98e-426f-baef-819cd7a8b2d9-ed175302-58cb-42ed-b575-e9f14db53253" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Creating volume ed175302-58cb-42ed-b575-e9f14db53253 from snapshot 175195f7-d98e-426f-baef-819cd7a8b2d9 {{(pid=82850) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "cinder-quobyte-ed175302-58cb-42ed-b575-e9f14db53253" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-quobyte-ed175302-58cb-42ed-b575-e9f14db53253" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] snapshot: 175195f7-d98e-426f-baef-819cd7a8b2d9, volume: ed175302-58cb-42ed-b575-e9f14db53253,  {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[406960d4-a913-438a-a82b-6f92f8cb18c0]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:04:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9" returned: 0 in 0.370s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 20:04:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 20:04:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 20:04:53 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1f0130-0b7a-4c72-91fa-238692b32b70]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:04:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9" returned: 0 in 0.388s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:53 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ed175302-58cb-42ed-b575-e9f14db53253 not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 20:04:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ed175302-58cb-42ed-b575-e9f14db53253 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:04:53 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=145, name=volume-ed175302-58cb-42ed-b575-e9f14db53253, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:04:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ed175302-58cb-42ed-b575-e9f14db53253" returned: 0 in 5.811s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:04:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dfa9e8-07fa-49bf-b325-8bcd7b4ad509]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:04:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9" returned: 0 in 0.572s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:00 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Image conversion details: src /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ed175302-58cb-42ed-b575-e9f14db53253 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 20:05:00 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Converted 1024.00 MB image at 175.50 MB/s
Sep 10 20:05:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ed175302-58cb-42ed-b575-e9f14db53253 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 20:05:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ed175302-58cb-42ed-b575-e9f14db53253 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ed175302-58cb-42ed-b575-e9f14db53253" returned: 0 in 0.078s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-quobyte-ed175302-58cb-42ed-b575-e9f14db53253" released by "_copy_volume_from_snapshot" :: held 7.535s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-quobyte-175195f7-d98e-426f-baef-819cd7a8b2d9-ed175302-58cb-42ed-b575-e9f14db53253" released by "_create_volume_from_snapshot" :: held 7.567s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.589s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca5a9af-cd8b-4855-a705-0198b4c9b49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed175302-58cb-42ed-b575-e9f14db53253', 'volume_size': 1, 'snapshot_id': '175195f7-d98e-426f-baef-819cd7a8b2d9'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64b1e12-7704-429d-949d-c26990d602a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:00 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Volume volume-ed175302-58cb-42ed-b575-e9f14db53253 (ed175302-58cb-42ed-b575-e9f14db53253): created successfully
Sep 10 20:05:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64b1e12-7704-429d-949d-c26990d602a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Flow 'volume_create_manager' (06f16cb9-e952-49ab-869b-ee065a7c0c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:00 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-844f41a4-017a-44b0-a3df-a944838a09cd tempest-SnapshotDependencyTests-1269470879 None] Created volume successfully.
Sep 10 20:05:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "cinder-175195f7-d98e-426f-baef-819cd7a8b2d9-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-175195f7-d98e-426f-baef-819cd7a8b2d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:01 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "cinder-quobyte-9d8202e4-c9a0-4e99-9c81-e79e96737cf9" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-quobyte-9d8202e4-c9a0-4e99-9c81-e79e96737cf9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "cinder-quobyte-175195f7-d98e-426f-baef-819cd7a8b2d9" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-quobyte-175195f7-d98e-426f-baef-819cd7a8b2d9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Deleting offline snapshot 175195f7-d98e-426f-baef-819cd7a8b2d9 of volume 9d8202e4-c9a0-4e99-9c81-e79e96737cf9 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 20:05:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] snapshot_file for this snap is: volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 20:05:01 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[45570572-9f33-4a12-92bd-e9ec2640a0f6]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:05:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9" returned: 0 in 0.374s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 20:05:02 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bd891b-2780-4be9-98b3-dde0d399dfac]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:05:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9" returned: 0 in 0.413s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9" returned: 0 in 0.188s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9.175195f7-d98e-426f-baef-819cd7a8b2d9" returned: 0 in 0.091s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-quobyte-175195f7-d98e-426f-baef-819cd7a8b2d9" released by "_delete_snapshot" :: held 1.311s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-quobyte-9d8202e4-c9a0-4e99-9c81-e79e96737cf9" released by "delete_snapshot" :: held 1.334s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:03 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Created reservations ['e062f3c5-2e9c-48a0-b032-420800c45b73', '422f253a-146a-431b-b976-ed7dd349c33e', '3bdb953b-39cc-4600-95dd-3968b092dc98', '2699ffda-248a-4dcb-b351-348d7a61e328'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:05:03 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Delete snapshot completed successfully.
Sep 10 20:05:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-31c81f0a-7c2e-4f3f-b996-ce65c813d764 tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-175195f7-d98e-426f-baef-819cd7a8b2d9-delete_snapshot" released by "delete_snapshot" :: held 1.733s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "cinder-9d8202e4-c9a0-4e99-9c81-e79e96737cf9-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-9d8202e4-c9a0-4e99-9c81-e79e96737cf9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:04 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "cinder-quobyte-9d8202e4-c9a0-4e99-9c81-e79e96737cf9" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-quobyte-9d8202e4-c9a0-4e99-9c81-e79e96737cf9" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:04 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e565b8a-596c-4fc0-86a1-878de48b00cf]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:05:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9" returned: 0 in 0.381s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-9d8202e4-c9a0-4e99-9c81-e79e96737cf9" returned: 0 in 0.111s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-quobyte-9d8202e4-c9a0-4e99-9c81-e79e96737cf9" released by "delete_volume" :: held 0.636s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Created reservations ['b6e91304-368d-433f-8961-7366c16e4925', 'e2a7e4b6-c831-4461-a301-1c47b10e8495', 'b4290cd2-85af-4fcd-9be4-2bf373e86752', '9afa08f0-dfc0-4db1-b32e-72db62662889'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "cinder-ed175302-58cb-42ed-b575-e9f14db53253-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.274s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:05:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Deleted volume successfully.
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-ed175302-58cb-42ed-b575-e9f14db53253-delete_volume" acquired by "delete_volume" :: waited 0.205s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4966b2e1-2081-4ecf-bab6-0a95fc81faaa tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-9d8202e4-c9a0-4e99-9c81-e79e96737cf9-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:05 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "cinder-quobyte-ed175302-58cb-42ed-b575-e9f14db53253" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-quobyte-ed175302-58cb-42ed-b575-e9f14db53253" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec98915-01e2-46bb-9446-12a3d2f23c45]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:05:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ed175302-58cb-42ed-b575-e9f14db53253 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ed175302-58cb-42ed-b575-e9f14db53253" returned: 0 in 0.386s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ed175302-58cb-42ed-b575-e9f14db53253 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ed175302-58cb-42ed-b575-e9f14db53253" returned: 0 in 0.079s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-quobyte-ed175302-58cb-42ed-b575-e9f14db53253" released by "delete_volume" :: held 0.613s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:06 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Created reservations ['9f94a5ea-760c-46ad-b2ff-ef7159fcdf50', '49692063-75c4-4621-92c6-5d277b050eca', 'ab36c448-0278-4159-a0a5-7879a4e6a4ca', 'e96ac880-0634-4d8c-89e3-ddcaabac0ebc'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:05:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:05:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:05:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.081s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:06 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:05:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Deleted volume successfully.
Sep 10 20:05:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7663bc49-db2b-4a81-b909-6cc5d9f27488 tempest-SnapshotDependencyTests-1269470879 None] Lock "cinder-ed175302-58cb-42ed-b575-e9f14db53253-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 20:05:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:05:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:05:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.146s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:05:16 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=38,cinder:SELECT=17,cinder:DELETE=1,cinder:INSERT=6 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:05:17 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=22,cinder:UPDATE=15,cinder:DELETE=4,cinder:INSERT=6 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:05:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:05:36 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Flow 'volume_create_manager' (87ab8589-9ef2-4673-a40e-d53492c31cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc97bb83-b13a-404c-9024-49e1eabab783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc97bb83-b13a-404c-9024-49e1eabab783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf974b3-b89d-4889-9e80-6e2787f97838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e5b1e783574d489e33f258f0d19703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:36Z,use_quota=True,user_id='64aa2be06fac40f185916784114657f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0104e957-9507-4e22-9eaa-dbb6b5bcbe8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0104e957-9507-4e22-9eaa-dbb6b5bcbe8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc2ccb7-c79e-44b9-bdd9-89161e83c0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc2ccb7-c79e-44b9-bdd9-89161e83c0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf974b3-b89d-4889-9e80-6e2787f97838', 'volume_name': 'volume-ebf974b3-b89d-4889-9e80-6e2787f97838', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5968ab-9c65-43f1-9452-eeff957392f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5968ab-9c65-43f1-9452-eeff957392f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88fa66ff-d791-482e-9c97-d8da5256003e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:36 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Volume ebf974b3-b89d-4889-9e80-6e2787f97838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf974b3-b89d-4889-9e80-6e2787f97838', 'volume_size': 1}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf974b3-b89d-4889-9e80-6e2787f97838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e5b1e783574d489e33f258f0d19703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:36Z,use_quota=True,user_id='64aa2be06fac40f185916784114657f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Creating volume ebf974b3-b89d-4889-9e80-6e2787f97838 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:05:36 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:05:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ebf974b3-b89d-4889-9e80-6e2787f97838 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:36 devstack quobyte-client[82855]: System call of process 100401 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:05:36 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=146, name=volume-ebf974b3-b89d-4889-9e80-6e2787f97838, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:05:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ebf974b3-b89d-4889-9e80-6e2787f97838 1073741824" returned: 0 in 0.793s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ebf974b3-b89d-4889-9e80-6e2787f97838 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:38 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Flow 'volume_create_manager' (a785161e-5967-425f-9a11-5208191046cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6acd760b-959c-480a-90da-818bbcbd396f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:38 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Flow 'volume_create_manager' (3745c33f-1440-406c-8dfd-dbc1cf051472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdad37c-b4b6-42a9-9b1f-1e3cb9b79ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdad37c-b4b6-42a9-9b1f-1e3cb9b79ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1835711898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aecc910-c355-4d9e-8420-9cbf0553f7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff322670d1af44caa42e5135bb47a4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:37Z,use_quota=True,user_id='ca56d16689ce4f2eb7ea59b40f5d9ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8126c4-b0f3-474b-91f4-f12cd3f10f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8126c4-b0f3-474b-91f4-f12cd3f10f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8078fb8d-892d-4aa0-99fd-e455425f6dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8078fb8d-892d-4aa0-99fd-e455425f6dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aecc910-c355-4d9e-8420-9cbf0553f7cc', 'volume_name': 'volume-8aecc910-c355-4d9e-8420-9cbf0553f7cc', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb3d60b-003a-4a85-a79c-9409e420cd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb3d60b-003a-4a85-a79c-9409e420cd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6676b5-3b1b-4e75-bd22-4ff94042f6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:38 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Volume 8aecc910-c355-4d9e-8420-9cbf0553f7cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aecc910-c355-4d9e-8420-9cbf0553f7cc', 'volume_size': 1}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ebf974b3-b89d-4889-9e80-6e2787f97838" returned: 0 in 1.223s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] <== create_volume: return (2063ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.039s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1835711898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aecc910-c355-4d9e-8420-9cbf0553f7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff322670d1af44caa42e5135bb47a4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:37Z,use_quota=True,user_id='ca56d16689ce4f2eb7ea59b40f5d9ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Creating volume 8aecc910-c355-4d9e-8420-9cbf0553f7cc {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:05:38 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:05:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8aecc910-c355-4d9e-8420-9cbf0553f7cc 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:38 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=147, name=volume-8aecc910-c355-4d9e-8420-9cbf0553f7cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6acd760b-959c-480a-90da-818bbcbd396f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-521985207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baabdbb9-7a68-4b0d-beaa-a7ef750279e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff322670d1af44caa42e5135bb47a4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:36Z,use_quota=True,user_id='ca56d16689ce4f2eb7ea59b40f5d9ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166134b9-7184-4fc1-a423-1b4bdb9576c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166134b9-7184-4fc1-a423-1b4bdb9576c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11eda2fb-c6a0-497b-bec4-edf1225e117a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11eda2fb-c6a0-497b-bec4-edf1225e117a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baabdbb9-7a68-4b0d-beaa-a7ef750279e6', 'volume_name': 'volume-baabdbb9-7a68-4b0d-beaa-a7ef750279e6', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af6ee04-26b0-417a-997b-e0a38e4f8309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af6ee04-26b0-417a-997b-e0a38e4f8309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b286dfe-eb3c-4320-ba00-42c749033566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:39 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Volume baabdbb9-7a68-4b0d-beaa-a7ef750279e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baabdbb9-7a68-4b0d-beaa-a7ef750279e6', 'volume_size': 1}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:39 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Flow 'volume_create_manager' (171486a8-19e1-4dbf-b203-a7f3b96c6f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a104cdda-918a-4f1e-a4fe-c4b97f3aa93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a104cdda-918a-4f1e-a4fe-c4b97f3aa93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1114486296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff322670d1af44caa42e5135bb47a4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:38Z,use_quota=True,user_id='ca56d16689ce4f2eb7ea59b40f5d9ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36548355-d619-4e97-b683-226726208997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36548355-d619-4e97-b683-226726208997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34b084c-b8b8-437f-bafe-6c97c7d84a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34b084c-b8b8-437f-bafe-6c97c7d84a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266', 'volume_name': 'volume-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec289e1-073b-4e19-87b8-2c1ca7540e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec289e1-073b-4e19-87b8-2c1ca7540e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5dda320-5e5b-4035-bfc2-8bf24a16986b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:39 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Volume 2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266', 'volume_size': 1}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88fa66ff-d791-482e-9c97-d8da5256003e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf974b3-b89d-4889-9e80-6e2787f97838', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd684878-5bb5-453e-83e7-15260cd8cd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8aecc910-c355-4d9e-8420-9cbf0553f7cc 1073741824" returned: 0 in 1.039s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8aecc910-c355-4d9e-8420-9cbf0553f7cc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:39 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:05:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Flow 'volume_create_manager' (a699a4fc-582a-496d-9d68-c79f82961ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481f38e9-0134-4499-ae60-1a14b176fce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:40 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Volume volume-ebf974b3-b89d-4889-9e80-6e2787f97838 (ebf974b3-b89d-4889-9e80-6e2787f97838): created successfully
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd684878-5bb5-453e-83e7-15260cd8cd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Flow 'volume_create_manager' (87ab8589-9ef2-4673-a40e-d53492c31cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:40 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Flow 'volume_create_manager' (d8d67bb5-a03c-4be4-8b37-39c37ba18050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554fc8fe-fd02-407a-9815-665cbee25670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554fc8fe-fd02-407a-9815-665cbee25670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1013418065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8665b9f9-80ec-471a-aa2d-705b0c92ff0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff322670d1af44caa42e5135bb47a4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:39Z,use_quota=True,user_id='ca56d16689ce4f2eb7ea59b40f5d9ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0d39b1-c06b-4461-8017-357db59cea02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0d39b1-c06b-4461-8017-357db59cea02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8778e3-5987-4b3c-b7ba-2a03a3c65323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8778e3-5987-4b3c-b7ba-2a03a3c65323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8665b9f9-80ec-471a-aa2d-705b0c92ff0d', 'volume_name': 'volume-8665b9f9-80ec-471a-aa2d-705b0c92ff0d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125474c2-5f0d-4651-bfbc-97e561cb7368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125474c2-5f0d-4651-bfbc-97e561cb7368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2da1ac8-c093-4bdb-a0a5-19ea8dba04c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:40 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Volume 8665b9f9-80ec-471a-aa2d-705b0c92ff0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8665b9f9-80ec-471a-aa2d-705b0c92ff0d', 'volume_size': 1}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481f38e9-0134-4499-ae60-1a14b176fce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-136055648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c079334-3917-4b17-91ba-69225347c015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff322670d1af44caa42e5135bb47a4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:38Z,use_quota=True,user_id='ca56d16689ce4f2eb7ea59b40f5d9ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fc74e9-ef86-4e7b-8037-f99947c0a923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fc74e9-ef86-4e7b-8037-f99947c0a923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d74166b-f299-4243-b3ef-184d4caf1bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d74166b-f299-4243-b3ef-184d4caf1bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c079334-3917-4b17-91ba-69225347c015', 'volume_name': 'volume-1c079334-3917-4b17-91ba-69225347c015', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bece8f8e-a30c-4f09-b4c3-f040f278d94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bece8f8e-a30c-4f09-b4c3-f040f278d94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5cf6f0-fca5-4cd8-8e09-3b7a0da1acaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:40 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Volume 1c079334-3917-4b17-91ba-69225347c015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c079334-3917-4b17-91ba-69225347c015', 'volume_size': 1}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8aecc910-c355-4d9e-8420-9cbf0553f7cc" returned: 0 in 0.754s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] <== create_volume: return (1813ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:40 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b52732b0-4941-44f8-ab7d-54d3d785f77f tempest-CinderUnicodeTest-1633389784 None] Created volume successfully.
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.316s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-521985207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baabdbb9-7a68-4b0d-beaa-a7ef750279e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff322670d1af44caa42e5135bb47a4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:36Z,use_quota=True,user_id='ca56d16689ce4f2eb7ea59b40f5d9ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Creating volume baabdbb9-7a68-4b0d-beaa-a7ef750279e6 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:05:40 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-baabdbb9-7a68-4b0d-beaa-a7ef750279e6 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:40 devstack quobyte-client[82855]: System call of process 100411 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:05:40 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=148, name=volume-baabdbb9-7a68-4b0d-beaa-a7ef750279e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6676b5-3b1b-4e75-bd22-4ff94042f6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aecc910-c355-4d9e-8420-9cbf0553f7cc', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bd2350-1574-4791-b213-4c9bebcfd091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:40 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Volume volume-8aecc910-c355-4d9e-8420-9cbf0553f7cc (8aecc910-c355-4d9e-8420-9cbf0553f7cc): created successfully
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bd2350-1574-4791-b213-4c9bebcfd091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Flow 'volume_create_manager' (3745c33f-1440-406c-8dfd-dbc1cf051472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:40 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:40 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Flow 'volume_create_manager' (1eb5dd9e-53d8-49b8-8ebc-47ad423ce51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11b4720-fbb6-4c56-972a-9c9ad1e1b6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:41 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-47887a0e-a585-4440-952d-b012751fb370 tempest-CreateVolumesFromImageTest-1449950459 None] Created volume successfully.
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-baabdbb9-7a68-4b0d-beaa-a7ef750279e6 1073741824" returned: 0 in 0.669s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-baabdbb9-7a68-4b0d-beaa-a7ef750279e6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11b4720-fbb6-4c56-972a-9c9ad1e1b6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=539a9f43-bdec-4262-9b3f-39e6bcc59287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f1c0fd0ad564ae9974c498d5b319e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:40Z,use_quota=True,user_id='2ab6ba8ec44a488fb696e4258e54a8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4af1de9-764f-4bfc-ab43-c72e34770698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4af1de9-764f-4bfc-ab43-c72e34770698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62479b8e-eb98-42ed-938a-0995fa6f950d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-baabdbb9-7a68-4b0d-beaa-a7ef750279e6" returned: 0 in 0.525s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] <== create_volume: return (1230ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.073s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1114486296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff322670d1af44caa42e5135bb47a4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:38Z,use_quota=True,user_id='ca56d16689ce4f2eb7ea59b40f5d9ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Creating volume 2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:05:41 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:05:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:41 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=149, name=volume-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b286dfe-eb3c-4320-ba00-42c749033566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baabdbb9-7a68-4b0d-beaa-a7ef750279e6', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea06c5a-b0b6-4b94-bd21-8aee5d6521eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:42 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Flow 'volume_create_manager' (094f25d2-e884-4282-b31a-145299715c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a454bd5d-b907-40a4-9d2b-41c7cb56b57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:42 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Volume volume-baabdbb9-7a68-4b0d-beaa-a7ef750279e6 (baabdbb9-7a68-4b0d-beaa-a7ef750279e6): created successfully
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea06c5a-b0b6-4b94-bd21-8aee5d6521eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Flow 'volume_create_manager' (a785161e-5967-425f-9a11-5208191046cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266 1073741824" returned: 0 in 0.729s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62479b8e-eb98-42ed-938a-0995fa6f950d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '539a9f43-bdec-4262-9b3f-39e6bcc59287', 'volume_name': 'volume-539a9f43-bdec-4262-9b3f-39e6bcc59287', 'volume_size': 1, 'image_id': '9afebeb2-f038-4cc5-b001-8639bdbf588b', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '70e3c4968621500efb92e7aee273682c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f1c0fd0ad564ae9974c498d5b319e4d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a70dd28d1706e67071ea43c56b74eb71191580eff04b7b3fa8669c2e548068e709bf342b69a9c4e2d89bd30e1497e647ec73c1d254af301b0c0485f85e71c24', 'id': '9afebeb2-f038-4cc5-b001-8639bdbf588b', 'created_at': datetime.datetime(2025, 9, 10, 18, 5, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 18, 5, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9afebeb2-f038-4cc5-b001-8639bdbf588b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc56e77a680>}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87ff597-4d30-4278-9c51-0eb466c06dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87ff597-4d30-4278-9c51-0eb466c06dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4e9e4f-e140-4b96-892a-82b1cc43ed24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:42 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Volume 539a9f43-bdec-4262-9b3f-39e6bcc59287: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-539a9f43-bdec-4262-9b3f-39e6bcc59287', 'volume_size': 1, 'image_id': '9afebeb2-f038-4cc5-b001-8639bdbf588b', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '70e3c4968621500efb92e7aee273682c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f1c0fd0ad564ae9974c498d5b319e4d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a70dd28d1706e67071ea43c56b74eb71191580eff04b7b3fa8669c2e548068e709bf342b69a9c4e2d89bd30e1497e647ec73c1d254af301b0c0485f85e71c24', 'id': '9afebeb2-f038-4cc5-b001-8639bdbf588b', 'created_at': datetime.datetime(2025, 9, 10, 18, 5, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 18, 5, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9afebeb2-f038-4cc5-b001-8639bdbf588b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc56e77a680>}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Cloning 539a9f43-bdec-4262-9b3f-39e6bcc59287 from image 9afebeb2-f038-4cc5-b001-8639bdbf588b  at location (None, None). {{(pid=82850) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a454bd5d-b907-40a4-9d2b-41c7cb56b57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-580316878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d53b1e-de91-4577-8c41-2057322b7ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e5b1e783574d489e33f258f0d19703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:41Z,use_quota=True,user_id='64aa2be06fac40f185916784114657f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b040877-f65d-4e4a-96bb-2ef23d8bb026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b040877-f65d-4e4a-96bb-2ef23d8bb026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d5488e-5822-49b7-ac80-c476c3ee3827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d5488e-5822-49b7-ac80-c476c3ee3827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d53b1e-de91-4577-8c41-2057322b7ae7', 'volume_name': 'volume-43d53b1e-de91-4577-8c41-2057322b7ae7', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5561294-63db-4830-b266-906ccb3a3160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5561294-63db-4830-b266-906ccb3a3160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d695948-6acb-4b66-8c22-e0ed6982b49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:42 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Volume 43d53b1e-de91-4577-8c41-2057322b7ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d53b1e-de91-4577-8c41-2057322b7ae7', 'volume_size': 1}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:42 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-dc1b05ca-4a8a-4068-93ad-8207b4efe0a3 tempest-CreateVolumesFromImageTest-1449950459 None] Created volume successfully.
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266" returned: 0 in 0.400s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] <== create_volume: return (1184ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.539s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1013418065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8665b9f9-80ec-471a-aa2d-705b0c92ff0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff322670d1af44caa42e5135bb47a4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:39Z,use_quota=True,user_id='ca56d16689ce4f2eb7ea59b40f5d9ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Creating volume 8665b9f9-80ec-471a-aa2d-705b0c92ff0d {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:05:42 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:05:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8665b9f9-80ec-471a-aa2d-705b0c92ff0d 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:43 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=150, name=volume-8665b9f9-80ec-471a-aa2d-705b0c92ff0d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:05:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5dda320-5e5b-4035-bfc2-8bf24a16986b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b64d918-936a-43d9-bfea-cf39aeaed16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:43 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 20:05:43 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Image download 0.00 MB at 0.00 MB/s
Sep 10 20:05:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8665b9f9-80ec-471a-aa2d-705b0c92ff0d 1073741824" returned: 0 in 0.543s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8665b9f9-80ec-471a-aa2d-705b0c92ff0d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:43 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Volume volume-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266 (2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266): created successfully
Sep 10 20:05:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b64d918-936a-43d9-bfea-cf39aeaed16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Flow 'volume_create_manager' (171486a8-19e1-4dbf-b203-a7f3b96c6f17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:43 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede4a9b2-15df-46ec-ad16-018d0735a35a]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:05:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8665b9f9-80ec-471a-aa2d-705b0c92ff0d" returned: 0 in 0.505s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] <== create_volume: return (1123ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d8661f51-bab3-4c03-b025-51ffa66544e7 tempest-CreateVolumesFromImageTest-1449950459 None] Created volume successfully.
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.800s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-136055648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c079334-3917-4b17-91ba-69225347c015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff322670d1af44caa42e5135bb47a4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:38Z,use_quota=True,user_id='ca56d16689ce4f2eb7ea59b40f5d9ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Creating volume 1c079334-3917-4b17-91ba-69225347c015 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:05:44 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1c079334-3917-4b17-91ba-69225347c015 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:44 devstack quobyte-client[82855]: System call of process 100424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:05:44 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=151, name=volume-1c079334-3917-4b17-91ba-69225347c015, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:05:44 devstack sudo[100423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2da1ac8-c093-4bdb-a0a5-19ea8dba04c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8665b9f9-80ec-471a-aa2d-705b0c92ff0d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:44 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d794d592-4579-435a-b34b-a24573e134b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:44 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Volume volume-8665b9f9-80ec-471a-aa2d-705b0c92ff0d (8665b9f9-80ec-471a-aa2d-705b0c92ff0d): created successfully
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d794d592-4579-435a-b34b-a24573e134b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Flow 'volume_create_manager' (d8d67bb5-a03c-4be4-8b37-39c37ba18050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1c079334-3917-4b17-91ba-69225347c015 1073741824" returned: 0 in 0.590s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1c079334-3917-4b17-91ba-69225347c015 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:45 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a0386292-5762-47e7-828a-049dc83cee1c tempest-CreateVolumesFromImageTest-1449950459 None] Created volume successfully.
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1c079334-3917-4b17-91ba-69225347c015" returned: 0 in 0.302s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] <== create_volume: return (924ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.446s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-580316878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d53b1e-de91-4577-8c41-2057322b7ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e5b1e783574d489e33f258f0d19703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:41Z,use_quota=True,user_id='64aa2be06fac40f185916784114657f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Creating volume 43d53b1e-de91-4577-8c41-2057322b7ae7 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:05:45 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:45 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=152, name=volume-43d53b1e-de91-4577-8c41-2057322b7ae7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5cf6f0-fca5-4cd8-8e09-3b7a0da1acaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c079334-3917-4b17-91ba-69225347c015', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1c91f5-e3e0-4229-ba5a-eefc686d2f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7 1073741824" returned: 0 in 0.494s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:45 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Volume volume-1c079334-3917-4b17-91ba-69225347c015 (1c079334-3917-4b17-91ba-69225347c015): created successfully
Sep 10 20:05:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1c91f5-e3e0-4229-ba5a-eefc686d2f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Flow 'volume_create_manager' (a699a4fc-582a-496d-9d68-c79f82961ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7" returned: 0 in 0.468s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] <== create_volume: return (999ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:05:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "cinder-8665b9f9-80ec-471a-aa2d-705b0c92ff0d-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:46 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-15e0de66-dc30-44f3-bce5-1983e1013fcd tempest-CreateVolumesFromImageTest-1449950459 None] Created volume successfully.
Sep 10 20:05:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d695948-6acb-4b66-8c22-e0ed6982b49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d53b1e-de91-4577-8c41-2057322b7ae7', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c0a3cc-ff2d-4ddb-9a14-96482419d25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:05:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-8665b9f9-80ec-471a-aa2d-705b0c92ff0d-delete_volume" acquired by "delete_volume" :: waited 0.177s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:46 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Volume volume-43d53b1e-de91-4577-8c41-2057322b7ae7 (43d53b1e-de91-4577-8c41-2057322b7ae7): created successfully
Sep 10 20:05:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c0a3cc-ff2d-4ddb-9a14-96482419d25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:05:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Flow 'volume_create_manager' (094f25d2-e884-4282-b31a-145299715c3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:05:46 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-30d63705-908f-4d3c-a174-aa71a72259ab tempest-CinderUnicodeTest-1633389784 None] Created volume successfully.
Sep 10 20:05:46 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "cinder-quobyte-8665b9f9-80ec-471a-aa2d-705b0c92ff0d" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-quobyte-8665b9f9-80ec-471a-aa2d-705b0c92ff0d" acquired by "delete_volume" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:46 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1d3ef9-8a41-48f8-90b7-b0f9fec0f0a5]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:05:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8665b9f9-80ec-471a-aa2d-705b0c92ff0d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:46 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root
Sep 10 20:05:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD" returned: 0 in 3.062s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8665b9f9-80ec-471a-aa2d-705b0c92ff0d" returned: 0 in 0.546s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8665b9f9-80ec-471a-aa2d-705b0c92ff0d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:47 devstack sudo[100436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD
Sep 10 20:05:47 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 20:05:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8665b9f9-80ec-471a-aa2d-705b0c92ff0d" returned: 0 in 0.476s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-quobyte-8665b9f9-80ec-471a-aa2d-705b0c92ff0d" released by "delete_volume" :: held 1.183s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:47 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] Creating offline snapshot 301e0c21-b303-4202-b59e-284ddbcffd5d of volume 43d53b1e-de91-4577-8c41-2057322b7ae7 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 20:05:48 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffea4aa-f46c-4a92-9751-49aa00630a5e]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:05:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:48 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Created reservations ['fa6239ab-e48b-4993-934e-899287b0812b', '109aa990-2035-43c7-86e0-49e5e25cb98c', '5daa28af-f208-44a8-bf3b-604dbaae0796', 'f4e0344e-3845-4512-a82c-fda06561aa03'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:05:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:05:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:05:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7" returned: 0 in 0.828s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.258s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:49 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:05:49 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=153, name=volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:05:49 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Deleted volume successfully.
Sep 10 20:05:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d 1G" returned: 0 in 0.430s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): qemu-img rebase -u -b volume-43d53b1e-de91-4577-8c41-2057322b7ae7 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-df36c874-5a6c-439f-8af5-38cbf72089fb tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-8665b9f9-80ec-471a-aa2d-705b0c92ff0d-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] CMD "qemu-img rebase -u -b volume-43d53b1e-de91-4577-8c41-2057322b7ae7 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d" returned: 0 in 0.430s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 20:05:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "cinder-1c079334-3917-4b17-91ba-69225347c015-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d" returned: 0 in 0.486s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 20:05:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:50 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root
Sep 10 20:05:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-1c079334-3917-4b17-91ba-69225347c015-delete_volume" acquired by "delete_volume" :: waited 0.335s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD" returned: 1 in 3.576s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 20:05:50 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Temporary image 9afebeb2-f038-4cc5-b001-8639bdbf588b is fetched for user 2ab6ba8ec44a488fb696e4258e54a8ae. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 20:05:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d" returned: 0 in 0.390s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:51 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "cinder-quobyte-1c079334-3917-4b17-91ba-69225347c015" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.info" returned: 0 in 0.525s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 20:05:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:51 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d532fc-07d0-4d60-a4ad-3eb2ea8cf099]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:05:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.info" returned: 0 in 0.382s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-quobyte-1c079334-3917-4b17-91ba-69225347c015" acquired by "delete_volume" :: waited 0.423s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.740s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:51 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[474455a9-aeb4-481a-b189-e8c50542bd05]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:05:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1c079334-3917-4b17-91ba-69225347c015 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:51 devstack sudo[100459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD
Sep 10 20:05:51 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 20:05:52 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b3bfb39b-b390-4bec-9bb9-e8500b27bf8c tempest-CinderUnicodeTest-1633389784 None] Create snapshot completed successfully
Sep 10 20:05:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1c079334-3917-4b17-91ba-69225347c015" returned: 0 in 0.623s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1c079334-3917-4b17-91ba-69225347c015 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-1c079334-3917-4b17-91ba-69225347c015" returned: 0 in 0.128s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-quobyte-1c079334-3917-4b17-91ba-69225347c015" released by "delete_volume" :: held 1.072s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Acquiring lock "cinder-301e0c21-b303-4202-b59e-284ddbcffd5d-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Lock "cinder-301e0c21-b303-4202-b59e-284ddbcffd5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:53 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Acquiring lock "cinder-quobyte-43d53b1e-de91-4577-8c41-2057322b7ae7" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:53 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Created reservations ['bd1d9b5c-eda0-4e69-bcd0-590e0a33afcb', 'ecd52897-5556-4b54-b39a-32b6cfc9744b', 'de311e0f-3d37-48fc-a41d-73d2524bd977', '07be98cf-10d0-4e32-b029-6bf842b19850'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:05:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Lock "cinder-quobyte-43d53b1e-de91-4577-8c41-2057322b7ae7" acquired by "delete_snapshot" :: waited 0.042s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Acquiring lock "cinder-quobyte-301e0c21-b303-4202-b59e-284ddbcffd5d" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Lock "cinder-quobyte-301e0c21-b303-4202-b59e-284ddbcffd5d" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Deleting offline snapshot 301e0c21-b303-4202-b59e-284ddbcffd5d of volume 43d53b1e-de91-4577-8c41-2057322b7ae7 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 20:05:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] snapshot_file for this snap is: volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 20:05:53 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e60f93-db1c-444c-b2a3-59d036a965d6]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:05:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "cinder-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266-delete_volume" acquired by "delete_volume" :: waited 0.229s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:53 devstack quobyte-client[82855]: System call of process 100467 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:05:53 devstack quobyte-client[82855]: System call of process 100467 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:05:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d" returned: 0 in 0.840s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43d53b1e-de91-4577-8c41-2057322b7ae7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 20:05:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:05:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:05:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:54 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eafa57-c0b8-4c1b-b772-eab5393df6c3]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:05:54 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root
Sep 10 20:05:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD" returned: 0 in 3.486s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:55 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "cinder-quobyte-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 1.012s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:55 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:05:55 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Deleted volume successfully.
Sep 10 20:05:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-quobyte-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266" acquired by "delete_volume" :: waited 0.280s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:55 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1935d1e-2df4-46e1-b331-44ff2c4aa926]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:05:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7" returned: 0 in 0.873s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:55 devstack sudo[100474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD
Sep 10 20:05:55 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 20:05:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:55 devstack quobyte-client[82855]: System call of process 100479 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:05:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8cf842e6-72a3-4d15-82b0-05ca3bdfa5e0 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-1c079334-3917-4b17-91ba-69225347c015-delete_volume" released by "delete_volume" :: held 5.531s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d" returned: 0 in 0.433s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7.301e0c21-b303-4202-b59e-284ddbcffd5d" returned: 0 in 0.174s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Lock "cinder-quobyte-301e0c21-b303-4202-b59e-284ddbcffd5d" released by "_delete_snapshot" :: held 3.162s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266" returned: 0 in 0.946s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Lock "cinder-quobyte-43d53b1e-de91-4577-8c41-2057322b7ae7" released by "delete_snapshot" :: held 3.394s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266" returned: 0 in 0.459s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-quobyte-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266" released by "delete_volume" :: held 1.504s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:57 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Created reservations ['0e7a4035-5ff2-4915-b0d2-ee6ad56e73ab', '40e010c1-b298-4dbd-b2e9-7a0f81c7954f', '5aa01a87-06ef-4420-9b69-a17103a40aa9', '900be72d-8d27-4293-8c4a-7c05fec12ab5'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:05:57 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Created reservations ['58def54a-c51c-4f45-a3d3-1d5a869f0d0c', '67e11322-e2cc-42ff-b74f-6b60d7395446', 'c3b8bd8c-6a73-4856-b43d-2d1d692cf860', '85521a82-c0a4-4259-a866-3032699a4bc8'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:05:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:05:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:05:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Acquiring lock "cinder-43d53b1e-de91-4577-8c41-2057322b7ae7-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.695s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:57 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Lock "cinder-43d53b1e-de91-4577-8c41-2057322b7ae7-delete_volume" acquired by "delete_volume" :: waited 0.243s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:58 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root
Sep 10 20:05:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Deleted volume successfully.
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD" returned: 1 in 3.236s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=539a9f43-bdec-4262-9b3f-39e6bcc59287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f1c0fd0ad564ae9974c498d5b319e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:05:40Z,use_quota=True,user_id='2ab6ba8ec44a488fb696e4258e54a8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Creating volume 539a9f43-bdec-4262-9b3f-39e6bcc59287 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:05:58 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:58 devstack quobyte-client[82855]: System call of process 100490 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:05:58 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=155, name=volume-539a9f43-bdec-4262-9b3f-39e6bcc59287, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "cinder-8aecc910-c355-4d9e-8420-9cbf0553f7cc-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Delete snapshot completed successfully.
Sep 10 20:05:58 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Acquiring lock "cinder-quobyte-43d53b1e-de91-4577-8c41-2057322b7ae7" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287 1073741824" returned: 0 in 0.537s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e22696fb-ee4f-4748-be95-b17b5c1830b2 tempest-CinderUnicodeTest-1633389784 None] Lock "cinder-301e0c21-b303-4202-b59e-284ddbcffd5d-delete_snapshot" released by "delete_snapshot" :: held 5.785s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-70943173-1397-4a16-a868-3692ee3ad728 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-2a4c5a9d-c9b8-47de-86cc-9d6c06ab8266-delete_volume" released by "delete_volume" :: held 5.034s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:05:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-8aecc910-c355-4d9e-8420-9cbf0553f7cc-delete_volume" acquired by "delete_volume" :: waited 0.564s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Lock "cinder-quobyte-43d53b1e-de91-4577-8c41-2057322b7ae7" acquired by "delete_volume" :: waited 0.352s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287" returned: 0 in 0.374s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d45ed57-d279-4644-b833-3a1209a2e50b]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:05:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] <== create_volume: return (937ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:05:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:05:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:59 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Attempting download of 9afebeb2-f038-4cc5-b001-8639bdbf588b ((None, None)) to volume 539a9f43-bdec-4262-9b3f-39e6bcc59287. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 20:05:59 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:05:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "cinder-quobyte-8aecc910-c355-4d9e-8420-9cbf0553f7cc" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:05:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7" returned: 0 in 0.633s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:05:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-quobyte-8aecc910-c355-4d9e-8420-9cbf0553f7cc" acquired by "delete_volume" :: waited 0.052s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:05:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:05:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64ef609-7c90-4865-9538-d8589101c9c9]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8aecc910-c355-4d9e-8420-9cbf0553f7cc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:00 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[df84e963-6b63-4095-9749-5d142f4b4b5c]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9afebeb2-f038-4cc5-b001-8639bdbf588b_q0d37jas {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-43d53b1e-de91-4577-8c41-2057322b7ae7" returned: 0 in 0.412s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Lock "cinder-quobyte-43d53b1e-de91-4577-8c41-2057322b7ae7" released by "delete_volume" :: held 1.342s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8aecc910-c355-4d9e-8420-9cbf0553f7cc" returned: 0 in 0.657s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8aecc910-c355-4d9e-8420-9cbf0553f7cc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9afebeb2-f038-4cc5-b001-8639bdbf588b_q0d37jas" returned: 0 in 0.861s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-8aecc910-c355-4d9e-8420-9cbf0553f7cc" returned: 0 in 0.320s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9afebeb2-f038-4cc5-b001-8639bdbf588b_q0d37jas {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-quobyte-8aecc910-c355-4d9e-8420-9cbf0553f7cc" released by "delete_volume" :: held 1.475s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:01 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Created reservations ['f4e5a566-0fd8-4a8c-86ea-d7cd5f1ad45e', 'ebfe67f9-ddb2-4066-ba82-bb708afe5885', 'ac1e1d35-9c89-45c7-ba7d-d28fc3da039d', '15f5909d-e00a-4b9c-b73c-a1506d5cebf4'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:06:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9afebeb2-f038-4cc5-b001-8639bdbf588b_q0d37jas" returned: 1 in 0.541s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9afebeb2-f038-4cc5-b001-8639bdbf588b_q0d37jas' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 20:06:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:01 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7170b0b0-6da7-4eda-93c5-8ba19357ab22]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.488s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:02 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:06:02 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Deleted volume successfully.
Sep 10 20:06:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Acquiring lock "cinder-ebf974b3-b89d-4889-9e80-6e2787f97838-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:02 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Created reservations ['75a27966-8f7a-44f6-8238-709ceb2259e1', '6e971883-ded9-4419-9ba8-327e0a9c5afd', 'a9c0e173-fd96-47c6-8268-e5712ea62ce2', '7f83cb65-96ca-4db8-8980-7d0991680d77'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:06:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD" returned: 0 in 0.570s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Lock "cinder-ebf974b3-b89d-4889-9e80-6e2787f97838-delete_volume" acquired by "delete_volume" :: waited 0.235s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-36a19c1b-1f2f-4e31-b74a-a15d31075f7d tempest-CinderUnicodeTest-1633389784 None] Lock "cinder-43d53b1e-de91-4577-8c41-2057322b7ae7-delete_volume" released by "delete_volume" :: held 4.910s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "cinder-baabdbb9-7a68-4b0d-beaa-a7ef750279e6-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:03 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Acquiring lock "cinder-quobyte-ebf974b3-b89d-4889-9e80-6e2787f97838" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD" returned: 1 in 0.931s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 20:06:03 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] 9afebeb2-f038-4cc5-b001-8639bdbf588b was raw, converting to raw {{(pid=82850) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 20:06:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:03 devstack quobyte-client[82855]: System call of process 100515 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:06:03 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=155, name=volume-539a9f43-bdec-4262-9b3f-39e6bcc59287, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:06:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.581s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:03 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:06:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-baabdbb9-7a68-4b0d-beaa-a7ef750279e6-delete_volume" acquired by "delete_volume" :: waited 0.320s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Lock "cinder-quobyte-ebf974b3-b89d-4889-9e80-6e2787f97838" acquired by "delete_volume" :: waited 0.384s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:03 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8fcdb3-b3c5-4970-94c7-e2a382e31e7d]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ebf974b3-b89d-4889-9e80-6e2787f97838 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287" returned: 0 in 0.514s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:03 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Deleted volume successfully.
Sep 10 20:06:04 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9afebeb2-f038-4cc5-b001-8639bdbf588b_vvdydkxadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 20:06:04 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Converted 0.00 MB image at 0.00 MB/s
Sep 10 20:06:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:04 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "cinder-quobyte-baabdbb9-7a68-4b0d-beaa-a7ef750279e6" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-quobyte-baabdbb9-7a68-4b0d-beaa-a7ef750279e6" acquired by "delete_volume" :: waited 0.116s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ded58b9f-8ef8-483c-8f09-48ba73ab2c86 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-8aecc910-c355-4d9e-8420-9cbf0553f7cc-delete_volume" released by "delete_volume" :: held 5.551s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287 1G" returned: 0 in 0.376s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ebf974b3-b89d-4889-9e80-6e2787f97838" returned: 0 in 0.742s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:04 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa102a1-d033-4c61-b4ea-f0d358f06650]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ebf974b3-b89d-4889-9e80-6e2787f97838 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-baabdbb9-7a68-4b0d-beaa-a7ef750279e6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:04 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[095a5ee1-f778-4d6f-953e-43876b1c212d]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-ebf974b3-b89d-4889-9e80-6e2787f97838" returned: 0 in 0.375s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Lock "cinder-quobyte-ebf974b3-b89d-4889-9e80-6e2787f97838" released by "delete_volume" :: held 1.307s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:05 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Created reservations ['5c54fbc8-a6b6-453e-a209-7ab8450adaf4', '428c6c12-bb59-42a2-9c19-8c6cf88279aa', '4947bf08-dfaf-43ae-b190-cca3a733d064', 'a64bc6ae-fdd4-4675-b1fe-81991752becf'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:06:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-baabdbb9-7a68-4b0d-beaa-a7ef750279e6" returned: 0 in 0.770s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-baabdbb9-7a68-4b0d-beaa-a7ef750279e6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287" returned: 0 in 0.948s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-baabdbb9-7a68-4b0d-beaa-a7ef750279e6" returned: 0 in 0.449s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-quobyte-baabdbb9-7a68-4b0d-beaa-a7ef750279e6" released by "delete_volume" :: held 1.589s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287" returned: 1 in 0.885s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Downloaded image 9afebeb2-f038-4cc5-b001-8639bdbf588b ((None, None)) to volume 539a9f43-bdec-4262-9b3f-39e6bcc59287 successfully. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Temporary image 9afebeb2-f038-4cc5-b001-8639bdbf588b for user 2ab6ba8ec44a488fb696e4258e54a8ae is deleted. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Marking volume 539a9f43-bdec-4262-9b3f-39e6bcc59287 as bootable. {{(pid=82850) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.468s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Created reservations ['4309b7a8-7ad7-433d-8e23-2a80196e1639', 'ca248a71-2610-4bc1-80c9-99bea6b7f2b4', 'd3b0301e-32b9-418c-aa27-d98e114d1be3', '59e7ba13-2c05-4d39-8265-cc7481f636df'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:06:06 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Deleted volume successfully.
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Copying metadata from image 9afebeb2-f038-4cc5-b001-8639bdbf588b to 539a9f43-bdec-4262-9b3f-39e6bcc59287. {{(pid=82850) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Creating volume glance metadata for volume 539a9f43-bdec-4262-9b3f-39e6bcc59287 backed by image 9afebeb2-f038-4cc5-b001-8639bdbf588b with: {'image_id': '9afebeb2-f038-4cc5-b001-8639bdbf588b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '70e3c4968621500efb92e7aee273682c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82850) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 20:06:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d3ed3021-11a6-48a4-ae9a-72ed010dc98c tempest-CinderUnicodeTest-1633389784 None] Lock "cinder-ebf974b3-b89d-4889-9e80-6e2787f97838-delete_volume" released by "delete_volume" :: held 4.424s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4e9e4f-e140-4b96-892a-82b1cc43ed24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-539a9f43-bdec-4262-9b3f-39e6bcc59287', 'volume_size': 1, 'image_id': '9afebeb2-f038-4cc5-b001-8639bdbf588b', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '70e3c4968621500efb92e7aee273682c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f1c0fd0ad564ae9974c498d5b319e4d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a70dd28d1706e67071ea43c56b74eb71191580eff04b7b3fa8669c2e548068e709bf342b69a9c4e2d89bd30e1497e647ec73c1d254af301b0c0485f85e71c24', 'id': '9afebeb2-f038-4cc5-b001-8639bdbf588b', 'created_at': datetime.datetime(2025, 9, 10, 18, 5, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 18, 5, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9afebeb2-f038-4cc5-b001-8639bdbf588b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc56e77a680>}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84daad2-3b00-48ac-893c-372197ace4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.148s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:07 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:06:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Deleted volume successfully.
Sep 10 20:06:07 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Volume volume-539a9f43-bdec-4262-9b3f-39e6bcc59287 (539a9f43-bdec-4262-9b3f-39e6bcc59287): created successfully
Sep 10 20:06:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84daad2-3b00-48ac-893c-372197ace4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Flow 'volume_create_manager' (1eb5dd9e-53d8-49b8-8ebc-47ad423ce51c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e37b0f08-a00e-4c42-8a0d-a36f03f4a68a tempest-VolumeImageDependencyTests-1328597653 None] Created volume successfully.
Sep 10 20:06:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-23dcdb76-d3f9-4fb1-a33b-6220118d7291 tempest-CreateVolumesFromImageTest-1449950459 None] Lock "cinder-baabdbb9-7a68-4b0d-beaa-a7ef750279e6-delete_volume" released by "delete_volume" :: held 4.054s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Acquiring lock "cinder-539a9f43-bdec-4262-9b3f-39e6bcc59287-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Lock "cinder-539a9f43-bdec-4262-9b3f-39e6bcc59287-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:08 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Acquiring lock "cinder-quobyte-539a9f43-bdec-4262-9b3f-39e6bcc59287" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Lock "cinder-quobyte-539a9f43-bdec-4262-9b3f-39e6bcc59287" acquired by "delete_volume" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:08 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64dda09-bb91-424b-80dc-d1212a2a3348]: (4, 'raw') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287" returned: 0 in 0.501s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287" returned: 1 in 0.562s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 20:06:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-539a9f43-bdec-4262-9b3f-39e6bcc59287" returned: 0 in 0.141s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Lock "cinder-quobyte-539a9f43-bdec-4262-9b3f-39e6bcc59287" released by "delete_volume" :: held 1.486s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:10 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Created reservations ['7ef02526-8430-44da-9155-308b8b75b9e5', '6287317f-1270-460e-a4fe-fc51b7645f71', 'f75a01ef-0461-4b6f-997b-e53ff9bceeff', '4642bcaa-96e1-4296-b4fa-55efa7d0d952'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:06:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.205s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:11 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:06:11 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Deleted volume successfully.
Sep 10 20:06:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fc94484d-5761-48c3-97d5-f314fe54d93a tempest-VolumeImageDependencyTests-1328597653 None] Lock "cinder-539a9f43-bdec-4262-9b3f-39e6bcc59287-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:12 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Flow 'volume_create_manager' (3986e1a8-c6a1-4345-ae10-4ea1a325c0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e723b78f-6434-4a54-a0b0-fab0a9073d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e723b78f-6434-4a54-a0b0-fab0a9073d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-950721193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea3360c-50d1-49c3-aeb4-07dcdeca4589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c0951a93914917ac20ada2341c0d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:12Z,use_quota=True,user_id='f0257f141a7445bc9a2b33d3d88b173f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88f5da7-f4db-4a89-97bb-858d6160e043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88f5da7-f4db-4a89-97bb-858d6160e043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b194ae1-8c4c-4264-b6c6-a4fb512736d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b194ae1-8c4c-4264-b6c6-a4fb512736d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea3360c-50d1-49c3-aeb4-07dcdeca4589', 'volume_name': 'volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90d9f68-b627-41e9-b41d-096b9c8ceb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90d9f68-b627-41e9-b41d-096b9c8ceb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b98375-73f1-48af-88eb-20de0d70b1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:12 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume bea3360c-50d1-49c3-aeb4-07dcdeca4589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589', 'volume_size': 1}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-950721193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea3360c-50d1-49c3-aeb4-07dcdeca4589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c0951a93914917ac20ada2341c0d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:12Z,use_quota=True,user_id='f0257f141a7445bc9a2b33d3d88b173f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Creating volume bea3360c-50d1-49c3-aeb4-07dcdeca4589 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:06:12 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:06:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:12 devstack quobyte-client[82855]: System call of process 100545 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:06:12 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=156, name=volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:06:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589 1073741824" returned: 0 in 0.464s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589" returned: 0 in 0.192s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] <== create_volume: return (734ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:06:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b98375-73f1-48af-88eb-20de0d70b1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffc7f6d-6b37-4964-9ec6-ead20fdac67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:13 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589 (bea3360c-50d1-49c3-aeb4-07dcdeca4589): created successfully
Sep 10 20:06:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffc7f6d-6b37-4964-9ec6-ead20fdac67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Flow 'volume_create_manager' (3986e1a8-c6a1-4345-ae10-4ea1a325c0ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:13 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3ef9c586-9194-403a-b9a9-04cb25af0092 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Created volume successfully.
Sep 10 20:06:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 20:06:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.158s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:06:15 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] Creating offline snapshot 23281bf9-2fdf-4b30-9893-9959d73aaedf of volume bea3360c-50d1-49c3-aeb4-07dcdeca4589 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 20:06:15 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84248a0-c55a-423d-b511-efb7a570cc42]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589" returned: 0 in 0.514s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:15 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=157, name=volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:06:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf 1G" returned: 0 in 0.208s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "qemu-img rebase -u -b volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf" returned: 0 in 0.125s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 20:06:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf" returned: 0 in 0.108s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 20:06:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf" returned: 0 in 0.081s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.info" returned: 0 in 0.086s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 20:06:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.info" returned: 0 in 0.097s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.568s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:17 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2799bc2d-a72f-47d4-844f-eb273779a9bf tempest-CreateVolumesFromSnapshotTest-2066238800 None] Create snapshot completed successfully
Sep 10 20:06:18 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Flow 'volume_create_manager' (aaeb314d-75a3-4905-a66b-ebc338d6721b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13873b17-fb29-4741-9e30-7d348108dfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13873b17-fb29-4741-9e30-7d348108dfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-196778561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3275c69d-af5d-440b-9309-ed1afcbbbb84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c0951a93914917ac20ada2341c0d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:19Z,use_quota=True,user_id='f0257f141a7445bc9a2b33d3d88b173f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7e553f-642c-4787-bec1-a6979e775b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7e553f-642c-4787-bec1-a6979e775b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3d57ef-7332-4fd6-b1b7-27646ceed349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3d57ef-7332-4fd6-b1b7-27646ceed349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3275c69d-af5d-440b-9309-ed1afcbbbb84', 'volume_name': 'volume-3275c69d-af5d-440b-9309-ed1afcbbbb84', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4257b6c1-ab5c-4ae2-9c66-7452eab6f45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4257b6c1-ab5c-4ae2-9c66-7452eab6f45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07da95d4-6f9a-471a-b5b1-a834cbeb352b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:18 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume 3275c69d-af5d-440b-9309-ed1afcbbbb84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3275c69d-af5d-440b-9309-ed1afcbbbb84', 'volume_size': 1}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-196778561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3275c69d-af5d-440b-9309-ed1afcbbbb84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c0951a93914917ac20ada2341c0d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:19Z,use_quota=True,user_id='f0257f141a7445bc9a2b33d3d88b173f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Creating volume 3275c69d-af5d-440b-9309-ed1afcbbbb84 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:06:18 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:06:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3275c69d-af5d-440b-9309-ed1afcbbbb84 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:19 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=159, name=volume-3275c69d-af5d-440b-9309-ed1afcbbbb84, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:06:20 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Flow 'volume_create_manager' (62e880d4-9525-47cd-b811-045333c4131f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2d66e1-120c-43f2-a8f2-f9f5afda17b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2d66e1-120c-43f2-a8f2-f9f5afda17b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1344357882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e26c16-0c06-4f2e-99b9-65738b9a3c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c0951a93914917ac20ada2341c0d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:19Z,use_quota=True,user_id='f0257f141a7445bc9a2b33d3d88b173f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406d682b-ffbd-4e6f-8bcb-59f917c4105d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406d682b-ffbd-4e6f-8bcb-59f917c4105d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb4f607-079d-4131-a757-27289ff3704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb4f607-079d-4131-a757-27289ff3704c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3e26c16-0c06-4f2e-99b9-65738b9a3c88', 'volume_name': 'volume-d3e26c16-0c06-4f2e-99b9-65738b9a3c88', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31159890-e754-42b2-aa29-d16db66fa420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31159890-e754-42b2-aa29-d16db66fa420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7776352-5f3d-48d0-b831-6e40f2c8e420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:20 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume d3e26c16-0c06-4f2e-99b9-65738b9a3c88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3e26c16-0c06-4f2e-99b9-65738b9a3c88', 'volume_size': 1}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:20 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Flow 'volume_create_manager' (bcc72a7c-b5fd-49e7-a7e7-4efefc9a8d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbc2e20-7387-43df-b30a-2bc843f6ea00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3275c69d-af5d-440b-9309-ed1afcbbbb84 1073741824" returned: 0 in 1.385s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3275c69d-af5d-440b-9309-ed1afcbbbb84 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbc2e20-7387-43df-b30a-2bc843f6ea00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098869488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d43c68-e5ba-4043-bb28-5fb4013f6567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c0951a93914917ac20ada2341c0d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:20Z,use_quota=True,user_id='f0257f141a7445bc9a2b33d3d88b173f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af420421-75ac-41d5-9759-75ded62bac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af420421-75ac-41d5-9759-75ded62bac63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b9cc55-ea76-42da-8feb-41a7e4fc924a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b9cc55-ea76-42da-8feb-41a7e4fc924a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d43c68-e5ba-4043-bb28-5fb4013f6567', 'volume_name': 'volume-57d43c68-e5ba-4043-bb28-5fb4013f6567', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (222df500-253d-4964-88da-223cdac5457c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (222df500-253d-4964-88da-223cdac5457c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde0b229-466f-41fa-9942-46a631e9cd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:21 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume 57d43c68-e5ba-4043-bb28-5fb4013f6567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d43c68-e5ba-4043-bb28-5fb4013f6567', 'volume_size': 1}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3275c69d-af5d-440b-9309-ed1afcbbbb84" returned: 0 in 0.729s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] <== create_volume: return (2173ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.851s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1344357882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e26c16-0c06-4f2e-99b9-65738b9a3c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c0951a93914917ac20ada2341c0d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:19Z,use_quota=True,user_id='f0257f141a7445bc9a2b33d3d88b173f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Creating volume d3e26c16-0c06-4f2e-99b9-65738b9a3c88 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:06:21 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d3e26c16-0c06-4f2e-99b9-65738b9a3c88 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:21 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=160, name=volume-d3e26c16-0c06-4f2e-99b9-65738b9a3c88, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07da95d4-6f9a-471a-b5b1-a834cbeb352b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3275c69d-af5d-440b-9309-ed1afcbbbb84', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d632487-077b-4a3c-89f1-32d717c6f792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:21 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Flow 'volume_create_manager' (cc72a7af-84e7-4732-89fe-0012b08fb35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d3e23e-95e9-45e4-bc2c-a2f9891e3060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:21 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume volume-3275c69d-af5d-440b-9309-ed1afcbbbb84 (3275c69d-af5d-440b-9309-ed1afcbbbb84): created successfully
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d632487-077b-4a3c-89f1-32d717c6f792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Flow 'volume_create_manager' (aaeb314d-75a3-4905-a66b-ebc338d6721b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:21 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:21 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Flow 'volume_create_manager' (4b54d6b8-f867-4ca7-a296-61c59d3666a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28248d10-7639-4902-b5da-fe4c15ee763b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28248d10-7639-4902-b5da-fe4c15ee763b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1873639692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5f30e6-d2f4-4942-adc1-df4351d2dbac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c0951a93914917ac20ada2341c0d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:21Z,use_quota=True,user_id='f0257f141a7445bc9a2b33d3d88b173f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb4a0c5-1154-46b8-b1eb-fdc74a9855df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb4a0c5-1154-46b8-b1eb-fdc74a9855df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6c1c7a-f2cb-450a-a4de-4d8786388e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6c1c7a-f2cb-450a-a4de-4d8786388e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e5f30e6-d2f4-4942-adc1-df4351d2dbac', 'volume_name': 'volume-3e5f30e6-d2f4-4942-adc1-df4351d2dbac', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1caa96d-74f3-4b7e-b4cf-a1814f9345b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1caa96d-74f3-4b7e-b4cf-a1814f9345b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f669d5af-4a03-46cb-92f2-f3eb46aed054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:22 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume 3e5f30e6-d2f4-4942-adc1-df4351d2dbac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e5f30e6-d2f4-4942-adc1-df4351d2dbac', 'volume_size': 1}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d3e23e-95e9-45e4-bc2c-a2f9891e3060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2023993593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525529f5-f566-4035-9007-ae6e6649da24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c0951a93914917ac20ada2341c0d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:20Z,use_quota=True,user_id='f0257f141a7445bc9a2b33d3d88b173f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763e6b4c-cb7a-4422-a9bc-1beb4354ea43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763e6b4c-cb7a-4422-a9bc-1beb4354ea43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4815241-8ecd-4845-b1cd-57271093f8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4815241-8ecd-4845-b1cd-57271093f8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '525529f5-f566-4035-9007-ae6e6649da24', 'volume_name': 'volume-525529f5-f566-4035-9007-ae6e6649da24', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bc2382-0bd0-43e3-b1cb-12478fd67728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bc2382-0bd0-43e3-b1cb-12478fd67728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63664afe-404c-46c5-9529-834998371446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:22 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume 525529f5-f566-4035-9007-ae6e6649da24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-525529f5-f566-4035-9007-ae6e6649da24', 'volume_size': 1}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d3e26c16-0c06-4f2e-99b9-65738b9a3c88 1073741824" returned: 0 in 1.003s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d3e26c16-0c06-4f2e-99b9-65738b9a3c88 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-961fac0d-83fb-46d4-8f48-a5b09db27780 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Created volume successfully.
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d3e26c16-0c06-4f2e-99b9-65738b9a3c88" returned: 0 in 0.348s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] <== create_volume: return (1398ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.579s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098869488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d43c68-e5ba-4043-bb28-5fb4013f6567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c0951a93914917ac20ada2341c0d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:20Z,use_quota=True,user_id='f0257f141a7445bc9a2b33d3d88b173f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Creating volume 57d43c68-e5ba-4043-bb28-5fb4013f6567 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:06:22 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-57d43c68-e5ba-4043-bb28-5fb4013f6567 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:22 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=161, name=volume-57d43c68-e5ba-4043-bb28-5fb4013f6567, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7776352-5f3d-48d0-b831-6e40f2c8e420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3e26c16-0c06-4f2e-99b9-65738b9a3c88', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0641898-441b-4cec-865a-dd22f9c094aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:23 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume volume-d3e26c16-0c06-4f2e-99b9-65738b9a3c88 (d3e26c16-0c06-4f2e-99b9-65738b9a3c88): created successfully
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0641898-441b-4cec-865a-dd22f9c094aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Flow 'volume_create_manager' (62e880d4-9525-47cd-b811-045333c4131f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9504eea5-9388-41e2-9089-ec72e6711931 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Created volume successfully.
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-57d43c68-e5ba-4043-bb28-5fb4013f6567 1073741824" returned: 0 in 0.557s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-57d43c68-e5ba-4043-bb28-5fb4013f6567 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-57d43c68-e5ba-4043-bb28-5fb4013f6567" returned: 0 in 0.329s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] <== create_volume: return (932ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.595s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1873639692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5f30e6-d2f4-4942-adc1-df4351d2dbac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c0951a93914917ac20ada2341c0d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:21Z,use_quota=True,user_id='f0257f141a7445bc9a2b33d3d88b173f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Creating volume 3e5f30e6-d2f4-4942-adc1-df4351d2dbac {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:06:23 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:06:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3e5f30e6-d2f4-4942-adc1-df4351d2dbac 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:23 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=162, name=volume-3e5f30e6-d2f4-4942-adc1-df4351d2dbac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde0b229-466f-41fa-9942-46a631e9cd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d43c68-e5ba-4043-bb28-5fb4013f6567', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06abfcb1-a1ba-47f6-ae9c-8132ff161bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:24 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume volume-57d43c68-e5ba-4043-bb28-5fb4013f6567 (57d43c68-e5ba-4043-bb28-5fb4013f6567): created successfully
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06abfcb1-a1ba-47f6-ae9c-8132ff161bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Flow 'volume_create_manager' (bcc72a7c-b5fd-49e7-a7e7-4efefc9a8d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3e5f30e6-d2f4-4942-adc1-df4351d2dbac 1073741824" returned: 0 in 0.555s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3e5f30e6-d2f4-4942-adc1-df4351d2dbac {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3e5f30e6-d2f4-4942-adc1-df4351d2dbac" returned: 0 in 0.192s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] <== create_volume: return (817ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.556s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2023993593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525529f5-f566-4035-9007-ae6e6649da24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c0951a93914917ac20ada2341c0d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:20Z,use_quota=True,user_id='f0257f141a7445bc9a2b33d3d88b173f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Creating volume 525529f5-f566-4035-9007-ae6e6649da24 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:06:24 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:06:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-525529f5-f566-4035-9007-ae6e6649da24 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:24 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=163, name=volume-525529f5-f566-4035-9007-ae6e6649da24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:06:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-525529f5-f566-4035-9007-ae6e6649da24 1073741824" returned: 0 in 0.340s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-525529f5-f566-4035-9007-ae6e6649da24 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-525529f5-f566-4035-9007-ae6e6649da24" returned: 0 in 0.091s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] <== create_volume: return (543ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:06:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.611s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:25 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-acebd4b0-a125-4a15-843e-9592b7bb4e97 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Created volume successfully.
Sep 10 20:06:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f669d5af-4a03-46cb-92f2-f3eb46aed054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e5f30e6-d2f4-4942-adc1-df4351d2dbac', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf847112-9799-416b-9d46-c6447d44f1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63664afe-404c-46c5-9529-834998371446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-525529f5-f566-4035-9007-ae6e6649da24', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ebecfd-b2fa-4e28-bfd8-f15937412ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:26 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume volume-3e5f30e6-d2f4-4942-adc1-df4351d2dbac (3e5f30e6-d2f4-4942-adc1-df4351d2dbac): created successfully
Sep 10 20:06:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf847112-9799-416b-9d46-c6447d44f1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Flow 'volume_create_manager' (4b54d6b8-f867-4ca7-a296-61c59d3666a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:26 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume volume-525529f5-f566-4035-9007-ae6e6649da24 (525529f5-f566-4035-9007-ae6e6649da24): created successfully
Sep 10 20:06:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ebecfd-b2fa-4e28-bfd8-f15937412ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Flow 'volume_create_manager' (cc72a7af-84e7-4732-89fe-0012b08fb35c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:26 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-79ae5b68-9afc-47ce-afc8-f28e6d60d033 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Created volume successfully.
Sep 10 20:06:26 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-afd7e59e-7534-4916-a97d-b9926ca5fd5e tempest-CreateVolumesFromSnapshotTest-2066238800 None] Created volume successfully.
Sep 10 20:06:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "cinder-3e5f30e6-d2f4-4942-adc1-df4351d2dbac-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-3e5f30e6-d2f4-4942-adc1-df4351d2dbac-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:27 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=66,cinder:UPDATE=100,cinder:DELETE=8,cinder:INSERT=21 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:06:27 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "cinder-quobyte-3e5f30e6-d2f4-4942-adc1-df4351d2dbac" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-3e5f30e6-d2f4-4942-adc1-df4351d2dbac" acquired by "delete_volume" :: waited 0.028s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:27 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f06b232-b2a5-41c3-8cd9-1a3427225db3]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3e5f30e6-d2f4-4942-adc1-df4351d2dbac {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3e5f30e6-d2f4-4942-adc1-df4351d2dbac" returned: 0 in 0.784s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3e5f30e6-d2f4-4942-adc1-df4351d2dbac {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3e5f30e6-d2f4-4942-adc1-df4351d2dbac" returned: 0 in 0.130s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-3e5f30e6-d2f4-4942-adc1-df4351d2dbac" released by "delete_volume" :: held 1.131s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:29 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Created reservations ['47a4eed3-795a-4ab0-b969-ab781a868f64', '6ad8a2d0-c079-46de-903a-4c5327b51408', '65c5a119-5d26-4231-8241-42c2054cafd0', '11b76e36-aec4-49e0-a480-c21cdb6a2c40'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:06:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.147s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:29 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:06:29 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Deleted volume successfully.
Sep 10 20:06:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-73266137-eace-46ec-b38d-53db1e7426b4 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-3e5f30e6-d2f4-4942-adc1-df4351d2dbac-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "cinder-525529f5-f566-4035-9007-ae6e6649da24-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-525529f5-f566-4035-9007-ae6e6649da24-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:30 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "cinder-quobyte-525529f5-f566-4035-9007-ae6e6649da24" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-525529f5-f566-4035-9007-ae6e6649da24" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:30 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd855b9-c4fa-48fa-835b-826b09340d06]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-525529f5-f566-4035-9007-ae6e6649da24 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-525529f5-f566-4035-9007-ae6e6649da24" returned: 0 in 0.444s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-525529f5-f566-4035-9007-ae6e6649da24 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-525529f5-f566-4035-9007-ae6e6649da24" returned: 0 in 0.100s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-525529f5-f566-4035-9007-ae6e6649da24" released by "delete_volume" :: held 0.728s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:31 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Created reservations ['b40b2ecb-187e-4ac6-a019-eb02ffa92c11', '14aea282-d65a-4ded-b93a-cce3801fe55f', 'cc904e82-fe5b-45cf-a1c1-3f628ce5e0bb', '3e2b2a8e-9a4f-402f-8600-4ad7a40615d7'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:06:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.111s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:31 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:06:31 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Deleted volume successfully.
Sep 10 20:06:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6404b410-2e0c-45de-9998-ca7058a07881 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-525529f5-f566-4035-9007-ae6e6649da24-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "cinder-57d43c68-e5ba-4043-bb28-5fb4013f6567-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-57d43c68-e5ba-4043-bb28-5fb4013f6567-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:32 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "cinder-quobyte-57d43c68-e5ba-4043-bb28-5fb4013f6567" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-57d43c68-e5ba-4043-bb28-5fb4013f6567" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:32 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ae4b19-bdff-4542-9c27-2ed787beaad9]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-57d43c68-e5ba-4043-bb28-5fb4013f6567 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-57d43c68-e5ba-4043-bb28-5fb4013f6567" returned: 0 in 0.462s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-57d43c68-e5ba-4043-bb28-5fb4013f6567 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-57d43c68-e5ba-4043-bb28-5fb4013f6567" returned: 0 in 0.114s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-57d43c68-e5ba-4043-bb28-5fb4013f6567" released by "delete_volume" :: held 0.744s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:33 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Created reservations ['4bd26d64-d976-44a3-812d-34004768b016', '36a94afe-0143-475c-9668-d4d877f1e4cf', '7b5e5fc0-8be9-49bf-a078-2be9790c3c08', '02609860-b9eb-4952-a7de-c4401924b82d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:06:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.101s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:34 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:06:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Deleted volume successfully.
Sep 10 20:06:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ad2c21b-6aa9-46e8-9999-fefcc75180c3 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-57d43c68-e5ba-4043-bb28-5fb4013f6567-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "cinder-d3e26c16-0c06-4f2e-99b9-65738b9a3c88-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-d3e26c16-0c06-4f2e-99b9-65738b9a3c88-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=130,cinder:SELECT=84,cinder:DELETE=17,cinder:INSERT=32 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:06:35 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "cinder-quobyte-d3e26c16-0c06-4f2e-99b9-65738b9a3c88" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-d3e26c16-0c06-4f2e-99b9-65738b9a3c88" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:35 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[575d4ff5-b39f-4434-a198-3e53c437c43d]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d3e26c16-0c06-4f2e-99b9-65738b9a3c88 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d3e26c16-0c06-4f2e-99b9-65738b9a3c88" returned: 0 in 0.445s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d3e26c16-0c06-4f2e-99b9-65738b9a3c88 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-d3e26c16-0c06-4f2e-99b9-65738b9a3c88" returned: 0 in 0.124s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-d3e26c16-0c06-4f2e-99b9-65738b9a3c88" released by "delete_volume" :: held 0.765s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:36 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Created reservations ['9b47b239-b86a-4ec2-ac49-cb6a10eea8b3', 'c75955cf-0d37-44c3-9913-def3148001e4', 'c431ad80-eef4-40a8-a240-007a8a5fc761', '7dee7d75-cd9d-4147-9414-360a830c1c5a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:06:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.094s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:36 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:06:36 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Deleted volume successfully.
Sep 10 20:06:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d521a7dc-7c5d-4340-9d60-65070b52fa52 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-d3e26c16-0c06-4f2e-99b9-65738b9a3c88-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "cinder-3275c69d-af5d-440b-9309-ed1afcbbbb84-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-3275c69d-af5d-440b-9309-ed1afcbbbb84-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:37 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "cinder-quobyte-3275c69d-af5d-440b-9309-ed1afcbbbb84" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-3275c69d-af5d-440b-9309-ed1afcbbbb84" acquired by "delete_volume" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:37 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4dec8c-1a6f-4d2c-ad4f-626514c7f55c]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3275c69d-af5d-440b-9309-ed1afcbbbb84 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3275c69d-af5d-440b-9309-ed1afcbbbb84" returned: 0 in 0.453s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3275c69d-af5d-440b-9309-ed1afcbbbb84 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-3275c69d-af5d-440b-9309-ed1afcbbbb84" returned: 0 in 0.102s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-3275c69d-af5d-440b-9309-ed1afcbbbb84" released by "delete_volume" :: held 0.797s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:38 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Created reservations ['d8f1feec-1c9c-4966-86af-7934cff5a587', 'd69f736e-f1cb-4a69-98da-dc4f089f5dcc', 'f1745880-bcb6-4bf5-aee0-a4f05180884b', 'ca2e55b3-45dc-4043-a06f-e07664af7035'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:06:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.210s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:39 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:06:39 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Deleted volume successfully.
Sep 10 20:06:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "cinder-23281bf9-2fdf-4b30-9893-9959d73aaedf-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8adc9448-ed7c-4f4b-ba03-f5213aebf710 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-3275c69d-af5d-440b-9309-ed1afcbbbb84-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-23281bf9-2fdf-4b30-9893-9959d73aaedf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.086s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:40 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "cinder-quobyte-bea3360c-50d1-49c3-aeb4-07dcdeca4589" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-bea3360c-50d1-49c3-aeb4-07dcdeca4589" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "cinder-quobyte-23281bf9-2fdf-4b30-9893-9959d73aaedf" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-23281bf9-2fdf-4b30-9893-9959d73aaedf" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Deleting offline snapshot 23281bf9-2fdf-4b30-9893-9959d73aaedf of volume bea3360c-50d1-49c3-aeb4-07dcdeca4589 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 20:06:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] snapshot_file for this snap is: volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 20:06:40 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbc4509-9cbd-4d33-8b87-5a8852f9ebe3]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf" returned: 0 in 0.612s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 20:06:40 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d02081-f068-4270-86b5-3cf05ed350cf]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:41 devstack quobyte-client[82855]: System call of process 100653 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:06:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589" returned: 0 in 0.542s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:41 devstack quobyte-client[82855]: System call of process 100656 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:06:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf" returned: 0 in 0.405s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589.23281bf9-2fdf-4b30-9893-9959d73aaedf" returned: 0 in 0.149s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-23281bf9-2fdf-4b30-9893-9959d73aaedf" released by "_delete_snapshot" :: held 2.160s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-bea3360c-50d1-49c3-aeb4-07dcdeca4589" released by "delete_snapshot" :: held 2.208s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:42 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Created reservations ['3a766ff9-0d30-40ee-9585-92592ba7ab5b', '580f1892-4f03-49d1-a75f-a9fd72386b4f', '6569dfc3-f385-4cc3-979b-8377fe06b992', '77e5d2f7-ef6c-4e12-bc50-e6782f11b00a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:06:43 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Delete snapshot completed successfully.
Sep 10 20:06:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c06ee206-0b85-494b-b9cf-1deb6a7eccc5 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-23281bf9-2fdf-4b30-9893-9959d73aaedf-delete_snapshot" released by "delete_snapshot" :: held 3.124s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "cinder-bea3360c-50d1-49c3-aeb4-07dcdeca4589-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-bea3360c-50d1-49c3-aeb4-07dcdeca4589-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:44 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "cinder-quobyte-bea3360c-50d1-49c3-aeb4-07dcdeca4589" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-bea3360c-50d1-49c3-aeb4-07dcdeca4589" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:44 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac09f11-17c0-47c1-bf8e-e07ee26c603d]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589" returned: 0 in 0.560s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-bea3360c-50d1-49c3-aeb4-07dcdeca4589" returned: 0 in 0.127s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-quobyte-bea3360c-50d1-49c3-aeb4-07dcdeca4589" released by "delete_volume" :: held 0.857s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:45 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Created reservations ['5eb4bced-0195-4eb4-92cb-e79c8f72d372', '6c6df468-fef3-4cd5-8c15-b1048afab9f9', 'ff7cb029-f1ac-446a-80d8-9336bf5f62ee', '89c5e3c0-180d-4d46-bc68-09fc31c80d1c'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:06:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.326s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:06:46 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Deleted volume successfully.
Sep 10 20:06:46 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Flow 'volume_create_manager' (7e035cf7-1bb1-4292-8a06-c41739338085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9058902-b114-4b1f-aa58-fa84b4d75728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9058902-b114-4b1f-aa58-fa84b4d75728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-959418578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974b6fe1-5206-4ccb-bbbb-f0ccc47d7777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f88f6144694e4e838445b105d609c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:46Z,use_quota=True,user_id='24fec272873a4cf2ad1aded85e47c1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2bc7f8b-cb03-438e-a555-a5443f2da8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2bc7f8b-cb03-438e-a555-a5443f2da8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee911a4d-50c6-420b-b1d6-e9b4fb56673c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee911a4d-50c6-420b-b1d6-e9b4fb56673c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '974b6fe1-5206-4ccb-bbbb-f0ccc47d7777', 'volume_name': 'volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdcba74f-e485-4cbf-bfc1-4ebb359f239c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdcba74f-e485-4cbf-bfc1-4ebb359f239c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3811629-bf2a-4553-baf3-710e0442e90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:46 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Volume 974b6fe1-5206-4ccb-bbbb-f0ccc47d7777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777', 'volume_size': 1}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-959418578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974b6fe1-5206-4ccb-bbbb-f0ccc47d7777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f88f6144694e4e838445b105d609c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:46Z,use_quota=True,user_id='24fec272873a4cf2ad1aded85e47c1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Creating volume 974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:06:46 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:46 devstack quobyte-client[82855]: System call of process 100665 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:06:46 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=164, name=volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6c654570-3971-4b71-b055-ec229fc1b168 tempest-CreateVolumesFromSnapshotTest-2066238800 None] Lock "cinder-bea3360c-50d1-49c3-aeb4-07dcdeca4589-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 1073741824" returned: 0 in 0.354s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777" returned: 0 in 0.101s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] <== create_volume: return (510ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:06:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.524s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3811629-bf2a-4553-baf3-710e0442e90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934c37bf-6182-42b0-aac6-acbc9feee836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:47 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Volume volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 (974b6fe1-5206-4ccb-bbbb-f0ccc47d7777): created successfully
Sep 10 20:06:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934c37bf-6182-42b0-aac6-acbc9feee836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Flow 'volume_create_manager' (7e035cf7-1bb1-4292-8a06-c41739338085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:47 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d30df16f-1e41-4593-a8de-309adb09261e tempest-SnapshotDependencyTests-450064534 None] Created volume successfully.
Sep 10 20:06:48 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] Creating offline snapshot 1016ffaf-cfbd-4ade-8a7a-21f3f9302816 of volume 974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 20:06:48 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7268ba9c-4c61-4698-8772-6ea0c54d2325]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777" returned: 0 in 0.453s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:49 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=165, name=volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:06:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816 1G" returned: 0 in 0.260s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): qemu-img rebase -u -b volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:49 devstack quobyte-client[82855]: System call of process 100675 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:06:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] CMD "qemu-img rebase -u -b volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 -F qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816" returned: 0 in 0.160s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816 is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 20:06:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816" returned: 0 in 0.100s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] Setting permissions: /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 -> 1000:1000 {{(pid=82850) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 20:06:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816" returned: 0 in 0.367s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:50 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Flow 'volume_create_manager' (7c60aa37-8827-48b5-a0f7-88c5bd8de877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cb79ce-e9bc-4dd5-957e-fbbbd77a6db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.info" returned: 0 in 0.476s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.info is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cb79ce-e9bc-4dd5-957e-fbbbd77a6db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2080172320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdf5b0f-db06-4503-bafe-98bb47dd6fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b8029feb0d4d808b7d3b8a24894de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:50Z,use_quota=True,user_id='b10ed3b679f349b98a2022d67b45dcc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13c63f9-b0a7-442b-8fac-f6876cc8bdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13c63f9-b0a7-442b-8fac-f6876cc8bdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4f460a-cfb2-45b7-9c89-4a51aacdaa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4f460a-cfb2-45b7-9c89-4a51aacdaa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfdf5b0f-db06-4503-bafe-98bb47dd6fc3', 'volume_name': 'volume-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e4b049e-b35b-4ac4-bd03-fa72e984458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e4b049e-b35b-4ac4-bd03-fa72e984458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e537e0c4-6f6b-440a-9e59-f4f6bf0a9379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:50 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume dfdf5b0f-db06-4503-bafe-98bb47dd6fc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3', 'volume_size': 1}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.info" returned: 0 in 0.357s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.531s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.078s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2080172320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdf5b0f-db06-4503-bafe-98bb47dd6fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b8029feb0d4d808b7d3b8a24894de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:50Z,use_quota=True,user_id='b10ed3b679f349b98a2022d67b45dcc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Creating volume dfdf5b0f-db06-4503-bafe-98bb47dd6fc3 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:06:51 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:51 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=167, name=volume-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3 1073741824" returned: 0 in 0.445s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:51 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-540d330e-9547-4bf8-aee4-684c20554c76 tempest-SnapshotDependencyTests-450064534 None] Create snapshot completed successfully
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3" returned: 0 in 0.293s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] <== create_volume: return (770ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e537e0c4-6f6b-440a-9e59-f4f6bf0a9379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2acee11-dbd8-4d2d-97a2-de11742e46dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:52 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume volume-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3 (dfdf5b0f-db06-4503-bafe-98bb47dd6fc3): created successfully
Sep 10 20:06:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2acee11-dbd8-4d2d-97a2-de11742e46dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Flow 'volume_create_manager' (7c60aa37-8827-48b5-a0f7-88c5bd8de877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:52 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b0396773-1d52-4bf5-9351-a23c66846a72 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Created volume successfully.
Sep 10 20:06:53 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Flow 'volume_create_manager' (badf245a-d450-4f6e-b983-a4e0293d106c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fe6954-4062-4ab9-bcab-12d5710f02f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fe6954-4062-4ab9-bcab-12d5710f02f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7af5be3-9fcf-45ab-9f85-cc38b02f237b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f88f6144694e4e838445b105d609c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1016ffaf-cfbd-4ade-8a7a-21f3f9302816,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:53Z,use_quota=True,user_id='24fec272873a4cf2ad1aded85e47c1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47496747-ee6d-49e7-b209-2c67730af4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47496747-ee6d-49e7-b209-2c67730af4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40519972-1aab-4ad8-b4dd-d70bd4eb1de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40519972-1aab-4ad8-b4dd-d70bd4eb1de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a7af5be3-9fcf-45ab-9f85-cc38b02f237b', 'volume_name': 'volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b', 'volume_size': 1, 'snapshot_id': '1016ffaf-cfbd-4ade-8a7a-21f3f9302816'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a673ec9-73ea-45ac-9d6c-d0824265418f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a673ec9-73ea-45ac-9d6c-d0824265418f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2274b303-fadf-4854-bbd2-cda4ae5b0c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:53 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Volume a7af5be3-9fcf-45ab-9f85-cc38b02f237b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b', 'volume_size': 1, 'snapshot_id': '1016ffaf-cfbd-4ade-8a7a-21f3f9302816'}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "cinder-quobyte-1016ffaf-cfbd-4ade-8a7a-21f3f9302816-a7af5be3-9fcf-45ab-9f85-cc38b02f237b" by "_create_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-quobyte-1016ffaf-cfbd-4ade-8a7a-21f3f9302816-a7af5be3-9fcf-45ab-9f85-cc38b02f237b" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Creating volume a7af5be3-9fcf-45ab-9f85-cc38b02f237b from snapshot 1016ffaf-cfbd-4ade-8a7a-21f3f9302816 {{(pid=82850) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "cinder-quobyte-a7af5be3-9fcf-45ab-9f85-cc38b02f237b" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-quobyte-a7af5be3-9fcf-45ab-9f85-cc38b02f237b" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] snapshot: 1016ffaf-cfbd-4ade-8a7a-21f3f9302816, volume: a7af5be3-9fcf-45ab-9f85-cc38b02f237b,  {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f1eab4-3279-4a08-b4d5-2ebc47e4d87a]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816" returned: 0 in 0.673s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 20:06:54 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Flow 'volume_create_manager' (3b3199d5-40d9-400b-b9c7-a7507dbecfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d91637-0952-4b08-97ec-212c2549519a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fc78bc-185e-476b-9137-26550259a14d]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d91637-0952-4b08-97ec-212c2549519a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-754949567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6b5610-b118-434e-ad80-d28185e73fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b8029feb0d4d808b7d3b8a24894de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:54Z,use_quota=True,user_id='b10ed3b679f349b98a2022d67b45dcc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f51098a-cb67-47b6-bf6b-2487d6bc6faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f51098a-cb67-47b6-bf6b-2487d6bc6faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7a176e-5993-4abf-88c3-275d980bc100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7a176e-5993-4abf-88c3-275d980bc100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa6b5610-b118-434e-ad80-d28185e73fbc', 'volume_name': 'volume-fa6b5610-b118-434e-ad80-d28185e73fbc', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974613e1-9548-4df8-b451-1ee8f9974e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974613e1-9548-4df8-b451-1ee8f9974e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b83f08-cb45-4946-9377-c93cbe1f2744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:55 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume fa6b5610-b118-434e-ad80-d28185e73fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa6b5610-b118-434e-ad80-d28185e73fbc', 'volume_size': 1}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:55 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Flow 'volume_create_manager' (73c4e3f2-0917-4428-a32e-536c63ad443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ae287a-4bc3-45c4-8818-c36855f4823d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ae287a-4bc3-45c4-8818-c36855f4823d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1713644018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa657b9-4110-424f-867e-39f9dc438f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b8029feb0d4d808b7d3b8a24894de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:54Z,use_quota=True,user_id='b10ed3b679f349b98a2022d67b45dcc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66bfb2e1-c89f-4a6e-bcc3-1cec23c8f6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66bfb2e1-c89f-4a6e-bcc3-1cec23c8f6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb9f803-b65f-4068-922a-1e1ce23af265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb9f803-b65f-4068-922a-1e1ce23af265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aa657b9-4110-424f-867e-39f9dc438f6a', 'volume_name': 'volume-2aa657b9-4110-424f-867e-39f9dc438f6a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06db3f92-5127-4dee-bfbd-f38bd1816d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06db3f92-5127-4dee-bfbd-f38bd1816d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c4a387-fe17-4dc4-b72a-26cc32f4369a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:55 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume 2aa657b9-4110-424f-867e-39f9dc438f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aa657b9-4110-424f-867e-39f9dc438f6a', 'volume_size': 1}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777" returned: 0 in 0.816s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:06:55 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Flow 'volume_create_manager' (9717f0d8-568b-45c2-b19a-ea11d53d470a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba590c7f-ce6e-4ebd-a936-c4eb8ab0dc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 20:06:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:06:55 devstack quobyte-client[82855]: System call of process 100695 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:06:55 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=168, name=volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba590c7f-ce6e-4ebd-a936-c4eb8ab0dc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1878652976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b8029feb0d4d808b7d3b8a24894de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:55Z,use_quota=True,user_id='b10ed3b679f349b98a2022d67b45dcc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda1d12d-bbba-459c-85d8-8d833932bb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda1d12d-bbba-459c-85d8-8d833932bb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1692ddaf-866b-4aa2-b4c3-0e7b29b09886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1692ddaf-866b-4aa2-b4c3-0e7b29b09886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4', 'volume_name': 'volume-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ecde18-361e-4fa4-b296-43ff15e636a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ecde18-361e-4fa4-b296-43ff15e636a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccc504f-a3e0-469c-bc85-4c842142a542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:56 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume 0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4', 'volume_size': 1}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:56 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Flow 'volume_create_manager' (6bade0c6-50b8-429f-95da-5e21dc09b3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d94238-126e-425f-b320-4ff075de28c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d94238-126e-425f-b320-4ff075de28c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1646882466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b9ae28-d819-4ece-8003-714358514177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b8029feb0d4d808b7d3b8a24894de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:55Z,use_quota=True,user_id='b10ed3b679f349b98a2022d67b45dcc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0954c8d-d1d1-426c-9462-a3c1a9a2e5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0954c8d-d1d1-426c-9462-a3c1a9a2e5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a178278-d3c3-47d1-b0f8-6376e3cb8161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a178278-d3c3-47d1-b0f8-6376e3cb8161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b9ae28-d819-4ece-8003-714358514177', 'volume_name': 'volume-a9b9ae28-d819-4ece-8003-714358514177', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94879242-97fb-4e77-b5e6-833cbfb2afaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94879242-97fb-4e77-b5e6-833cbfb2afaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8d7928-9b3c-46b8-b99c-9e2084cd0792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:56 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume a9b9ae28-d819-4ece-8003-714358514177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b9ae28-d819-4ece-8003-714358514177', 'volume_size': 1}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:06:56 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Flow 'volume_create_manager' (c10c4089-45a5-471b-b62f-7bbfcb9d53d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:06:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840e6127-52f3-49d7-a378-e77ac4c4a0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840e6127-52f3-49d7-a378-e77ac4c4a0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-369205281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42804b88-e6f4-4c58-b61e-242f59d381cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b8029feb0d4d808b7d3b8a24894de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:56Z,use_quota=True,user_id='b10ed3b679f349b98a2022d67b45dcc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df6e136-dfeb-45b1-9f3e-529734ba18b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df6e136-dfeb-45b1-9f3e-529734ba18b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecb6a45-ff43-41e8-8083-990d62c00e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecb6a45-ff43-41e8-8083-990d62c00e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42804b88-e6f4-4c58-b61e-242f59d381cb', 'volume_name': 'volume-42804b88-e6f4-4c58-b61e-242f59d381cb', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4811ab43-dcc1-4f01-aa81-5f5cd5b9e235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4811ab43-dcc1-4f01-aa81-5f5cd5b9e235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:06:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3f790a-61ca-4424-9c2c-0c4ff9ee351a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:06:57 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume 42804b88-e6f4-4c58-b61e-242f59d381cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42804b88-e6f4-4c58-b61e-242f59d381cb', 'volume_size': 1}
Sep 10 20:06:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:07:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b" returned: 0 in 6.235s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:01 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a920dc00-ac40-445f-bca7-45e99f676aab]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:07:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777" returned: 0 in 0.552s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Image conversion details: src /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 20:07:02 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Converted 1024.00 MB image at 164.15 MB/s
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] File path /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b is being set with permissions: 660 {{(pid=82850) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b" returned: 0 in 0.087s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-quobyte-a7af5be3-9fcf-45ab-9f85-cc38b02f237b" released by "_copy_volume_from_snapshot" :: held 8.849s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-quobyte-1016ffaf-cfbd-4ade-8a7a-21f3f9302816-a7af5be3-9fcf-45ab-9f85-cc38b02f237b" released by "_create_volume_from_snapshot" :: held 8.884s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.909s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.451s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-754949567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6b5610-b118-434e-ad80-d28185e73fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b8029feb0d4d808b7d3b8a24894de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:54Z,use_quota=True,user_id='b10ed3b679f349b98a2022d67b45dcc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Creating volume fa6b5610-b118-434e-ad80-d28185e73fbc {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:07:02 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fa6b5610-b118-434e-ad80-d28185e73fbc 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:02 devstack quobyte-client[82855]: System call of process 100712 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:07:02 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=169, name=volume-fa6b5610-b118-434e-ad80-d28185e73fbc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2274b303-fadf-4854-bbd2-cda4ae5b0c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b', 'volume_size': 1, 'snapshot_id': '1016ffaf-cfbd-4ade-8a7a-21f3f9302816'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77d32ec-89e2-48b7-b766-c03feb9ef840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:07:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fa6b5610-b118-434e-ad80-d28185e73fbc 1073741824" returned: 0 in 0.512s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fa6b5610-b118-434e-ad80-d28185e73fbc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fa6b5610-b118-434e-ad80-d28185e73fbc" returned: 0 in 0.128s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] <== create_volume: return (684ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1713644018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa657b9-4110-424f-867e-39f9dc438f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b8029feb0d4d808b7d3b8a24894de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:54Z,use_quota=True,user_id='b10ed3b679f349b98a2022d67b45dcc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Creating volume 2aa657b9-4110-424f-867e-39f9dc438f6a {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:07:03 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2aa657b9-4110-424f-867e-39f9dc438f6a 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:03 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Volume volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b (a7af5be3-9fcf-45ab-9f85-cc38b02f237b): created successfully
Sep 10 20:07:03 devstack quobyte-client[82855]: System call of process 100717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:07:03 devstack quobyte-client[82855]: System call of process 100717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:07:03 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=170, name=volume-2aa657b9-4110-424f-867e-39f9dc438f6a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77d32ec-89e2-48b7-b766-c03feb9ef840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Flow 'volume_create_manager' (badf245a-d450-4f6e-b983-a4e0293d106c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b83f08-cb45-4946-9377-c93cbe1f2744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa6b5610-b118-434e-ad80-d28185e73fbc', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf5da7d-f805-4aeb-98a7-b041678f38b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2aa657b9-4110-424f-867e-39f9dc438f6a 1073741824" returned: 0 in 0.413s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2aa657b9-4110-424f-867e-39f9dc438f6a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:04 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume volume-fa6b5610-b118-434e-ad80-d28185e73fbc (fa6b5610-b118-434e-ad80-d28185e73fbc): created successfully
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf5da7d-f805-4aeb-98a7-b041678f38b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Flow 'volume_create_manager' (3b3199d5-40d9-400b-b9c7-a7507dbecfc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "cinder-1016ffaf-cfbd-4ade-8a7a-21f3f9302816-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:04 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a9dfdea9-4302-4ec3-b89a-fd76aa5c7b46 tempest-SnapshotDependencyTests-450064534 None] Created volume successfully.
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2aa657b9-4110-424f-867e-39f9dc438f6a" returned: 0 in 0.496s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] <== create_volume: return (938ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.798s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1878652976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b8029feb0d4d808b7d3b8a24894de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:55Z,use_quota=True,user_id='b10ed3b679f349b98a2022d67b45dcc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Creating volume 0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:07:04 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:04 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c5dc9836-ee5b-4d90-9ec6-6bd0081ddd7d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Created volume successfully.
Sep 10 20:07:04 devstack quobyte-client[82855]: System call of process 100721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:07:04 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=171, name=volume-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-1016ffaf-cfbd-4ade-8a7a-21f3f9302816-delete_snapshot" acquired by "delete_snapshot" :: waited 0.483s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:04 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "cinder-quobyte-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c4a387-fe17-4dc4-b72a-26cc32f4369a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa657b9-4110-424f-867e-39f9dc438f6a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6def8c-97d7-4e92-9408-57dd5f23f67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4 1073741824" returned: 0 in 0.550s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-quobyte-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777" acquired by "delete_snapshot" :: waited 0.260s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "cinder-quobyte-1016ffaf-cfbd-4ade-8a7a-21f3f9302816" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:05 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume volume-2aa657b9-4110-424f-867e-39f9dc438f6a (2aa657b9-4110-424f-867e-39f9dc438f6a): created successfully
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6def8c-97d7-4e92-9408-57dd5f23f67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Flow 'volume_create_manager' (73c4e3f2-0917-4428-a32e-536c63ad443d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4" returned: 0 in 0.471s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] <== create_volume: return (1045ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-quobyte-1016ffaf-cfbd-4ade-8a7a-21f3f9302816" acquired by "_delete_snapshot" :: waited 0.335s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Deleting offline snapshot 1016ffaf-cfbd-4ade-8a7a-21f3f9302816 of volume 974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] snapshot_file for this snap is: volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.494s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1646882466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b9ae28-d819-4ece-8003-714358514177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b8029feb0d4d808b7d3b8a24894de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:55Z,use_quota=True,user_id='b10ed3b679f349b98a2022d67b45dcc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Creating volume a9b9ae28-d819-4ece-8003-714358514177 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:07:05 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a9b9ae28-d819-4ece-8003-714358514177 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:05 devstack quobyte-client[82855]: System call of process 100725 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:07:05 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=172, name=volume-a9b9ae28-d819-4ece-8003-714358514177, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bf7b03-0b03-41c2-af99-e58fa85cb2b7]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f80a2dde-b016-403f-90d1-d6c91dc09d4d tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Created volume successfully.
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a9b9ae28-d819-4ece-8003-714358514177 1073741824" returned: 0 in 0.607s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a9b9ae28-d819-4ece-8003-714358514177 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccc504f-a3e0-469c-bc85-4c842142a542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e15bc4-df46-4040-a65c-5a6794d1b5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a9b9ae28-d819-4ece-8003-714358514177" returned: 0 in 0.395s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816" returned: 0 in 0.813s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] <== create_volume: return (1024ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.275s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fc5794f7dc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T18:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-369205281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42804b88-e6f4-4c58-b61e-242f59d381cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b8029feb0d4d808b7d3b8a24894de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T18:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T18:06:56Z,use_quota=True,user_id='b10ed3b679f349b98a2022d67b45dcc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55589d54-34bd-4292-9047-3ae634aa5287),volume_type_id=55589d54-34bd-4292-9047-3ae634aa5287)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Creating volume 42804b88-e6f4-4c58-b61e-242f59d381cb {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Selected 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 20:07:06 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] casted to 10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-42804b88-e6f4-4c58-b61e-242f59d381cb 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e811885e-f283-4813-b262-1b977fe48b54]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:07:06 devstack quobyte-client[82855]: System call of process 100732 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:07:06 devstack quobyte-client[82855]: The server volume:0cb7a17d-c4b2-4e14-8c86-258d5e55517f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=0cb7a17d-c4b2-4e14-8c86-258d5e55517f, inode=173, name=volume-42804b88-e6f4-4c58-b61e-242f59d381cb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.168), requestorAccessMask=0
Sep 10 20:07:06 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume volume-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4 (0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4): created successfully
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e15bc4-df46-4040-a65c-5a6794d1b5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Flow 'volume_create_manager' (9717f0d8-568b-45c2-b19a-ea11d53d470a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:07:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8d7928-9b3c-46b8-b99c-9e2084cd0792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b9ae28-d819-4ece-8003-714358514177', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:07:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82edaff-0668-44b0-b5c8-86c7f7bfad73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:07:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4b6d16c4-d4b6-496b-b182-03531fb6d885 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Created volume successfully.
Sep 10 20:07:07 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume volume-a9b9ae28-d819-4ece-8003-714358514177 (a9b9ae28-d819-4ece-8003-714358514177): created successfully
Sep 10 20:07:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82edaff-0668-44b0-b5c8-86c7f7bfad73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:07:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Flow 'volume_create_manager' (6bade0c6-50b8-429f-95da-5e21dc09b3ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:07:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-42804b88-e6f4-4c58-b61e-242f59d381cb 1073741824" returned: 0 in 0.887s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-42804b88-e6f4-4c58-b61e-242f59d381cb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-db82f676-1257-4452-92f5-8ea5ab9a317a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Created volume successfully.
Sep 10 20:07:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777" returned: 0 in 0.886s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-42804b88-e6f4-4c58-b61e-242f59d381cb" returned: 0 in 0.499s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] <== create_volume: return (1516ms) {'provider_location': '10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 20:07:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816" returned: 0 in 0.339s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3f790a-61ca-4424-9c2c-0c4ff9ee351a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42804b88-e6f4-4c58-b61e-242f59d381cb', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:07:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795f37ee-6618-408c-b83a-737a64b8a584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 20:07:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777.1016ffaf-cfbd-4ade-8a7a-21f3f9302816" returned: 0 in 0.326s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-quobyte-1016ffaf-cfbd-4ade-8a7a-21f3f9302816" released by "_delete_snapshot" :: held 3.136s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-quobyte-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777" released by "delete_snapshot" :: held 3.511s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:08 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume volume-42804b88-e6f4-4c58-b61e-242f59d381cb (42804b88-e6f4-4c58-b61e-242f59d381cb): created successfully
Sep 10 20:07:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795f37ee-6618-408c-b83a-737a64b8a584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 20:07:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Flow 'volume_create_manager' (c10c4089-45a5-471b-b62f-7bbfcb9d53d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 20:07:08 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-54dffe1f-53c2-45bc-85b9-8b2988f2cabf tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Created volume successfully.
Sep 10 20:07:08 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Created reservations ['6a42009d-cda2-4803-a311-b199a67929e6', '03ba5b63-2c87-44cc-b785-4e8dd28514c8', 'bad5a87f-f5e5-4ba4-a4e3-6be505c1a259', '4f0a6c5f-373e-4503-a785-915b84d874b1'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:07:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "cinder-42804b88-e6f4-4c58-b61e-242f59d381cb-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-42804b88-e6f4-4c58-b61e-242f59d381cb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:08 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:07:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "cinder-quobyte-42804b88-e6f4-4c58-b61e-242f59d381cb" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-quobyte-42804b88-e6f4-4c58-b61e-242f59d381cb" acquired by "delete_volume" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:09 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Delete snapshot completed successfully.
Sep 10 20:07:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-79dfda39-07bb-4afc-bd3d-b698a4638502 tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-1016ffaf-cfbd-4ade-8a7a-21f3f9302816-delete_snapshot" released by "delete_snapshot" :: held 4.416s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:09 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97e58a2-984b-4774-974b-f6470d01b016]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:07:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-42804b88-e6f4-4c58-b61e-242f59d381cb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-42804b88-e6f4-4c58-b61e-242f59d381cb" returned: 0 in 0.412s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-42804b88-e6f4-4c58-b61e-242f59d381cb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "cinder-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-42804b88-e6f4-4c58-b61e-242f59d381cb" returned: 0 in 0.294s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-quobyte-42804b88-e6f4-4c58-b61e-242f59d381cb" released by "delete_volume" :: held 0.925s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:10 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:07:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "cinder-quobyte-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-quobyte-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:10 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ff7583-1ce3-4559-a5b0-f68fc3e0daa9]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:07:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:10 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Created reservations ['04012c6e-99fd-4335-9fd5-cf11318389a5', '25187742-d217-4a21-b7e8-44207ffe4885', 'cc32175f-1095-4bc2-ba68-41d357dc1a09', '636ff3db-dccd-42fe-884c-1ab99d821cdc'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:07:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:07:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:07:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:07:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777" returned: 0 in 0.585s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.198s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:10 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:07:10 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Deleted volume successfully.
Sep 10 20:07:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777" returned: 0 in 0.321s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "cinder-a9b9ae28-d819-4ece-8003-714358514177-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-quobyte-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777" released by "delete_volume" :: held 1.106s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-65b9ac34-d06f-47dc-aa69-58667b5ac152 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-42804b88-e6f4-4c58-b61e-242f59d381cb-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-a9b9ae28-d819-4ece-8003-714358514177-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:11 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:07:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "cinder-quobyte-a9b9ae28-d819-4ece-8003-714358514177" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-quobyte-a9b9ae28-d819-4ece-8003-714358514177" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:11 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Created reservations ['e45f80c4-6abf-4f77-94ec-90854b468558', '040da334-2f22-45a6-bb41-3ea20d63d25f', '9f7d7c98-3c29-4fef-a3ae-fc9fc4c9094c', 'e85064c7-f6f5-46dc-8775-8e0f88b70e3d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:07:11 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e380d8-c86b-4804-84b5-3abbccdf5d10]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:07:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a9b9ae28-d819-4ece-8003-714358514177 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "cinder-a7af5be3-9fcf-45ab-9f85-cc38b02f237b-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a9b9ae28-d819-4ece-8003-714358514177" returned: 0 in 0.813s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a9b9ae28-d819-4ece-8003-714358514177 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-a7af5be3-9fcf-45ab-9f85-cc38b02f237b-delete_volume" acquired by "delete_volume" :: waited 0.438s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.520s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a9b9ae28-d819-4ece-8003-714358514177" returned: 0 in 0.355s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:12 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Deleted volume successfully.
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-quobyte-a9b9ae28-d819-4ece-8003-714358514177" released by "delete_volume" :: held 1.316s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f208e013-30e1-40cd-8f4b-80343fc1cd2a tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-974b6fe1-5206-4ccb-bbbb-f0ccc47d7777-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:12 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "cinder-quobyte-a7af5be3-9fcf-45ab-9f85-cc38b02f237b" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-quobyte-a7af5be3-9fcf-45ab-9f85-cc38b02f237b" acquired by "delete_volume" :: waited 0.020s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd84c8ca-2d4d-470f-8903-7fe857299be1]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:07:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:13 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Created reservations ['fb74f12c-7c30-4cd4-989f-34649a39591a', '8806f28e-9f72-4493-aafa-12eec0e2cd14', 'dcc65590-727c-4933-85fe-2101295e5af0', '5fff0b54-cedf-4f40-9211-a06df31be67c'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:07:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:07:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:07:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:07:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b" returned: 0 in 0.613s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.190s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:13 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:07:13 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Deleted volume successfully.
Sep 10 20:07:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-a7af5be3-9fcf-45ab-9f85-cc38b02f237b" returned: 0 in 0.319s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-quobyte-a7af5be3-9fcf-45ab-9f85-cc38b02f237b" released by "delete_volume" :: held 1.077s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3ed1f81d-d42f-4462-acff-f64792e0b637 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-a9b9ae28-d819-4ece-8003-714358514177-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Created reservations ['68165c7d-686d-4bdb-aa64-c8eaaa8cc3d0', '9e7b6e6b-816e-4788-97d4-6405b8fd63de', 'fe1705e6-aad3-4ddb-a3f9-27873c7eb688', '815ed136-4160-4b2b-a706-a4acb801ad9e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.089s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:07:14 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Deleted volume successfully.
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "cinder-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.352s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-bcfae4fc-81bc-46e4-9413-91bc3be98a17 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:07:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d8357d31-cfd7-49e2-919e-81dd9909da53 tempest-SnapshotDependencyTests-450064534 None] Lock "cinder-a7af5be3-9fcf-45ab-9f85-cc38b02f237b-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4-delete_volume" acquired by "delete_volume" :: waited 0.148s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:15 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:07:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "cinder-quobyte-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-quobyte-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:15 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0566e2-32dc-4a55-be01-1c4dee926759]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:07:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4" returned: 0 in 0.461s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4" returned: 0 in 0.106s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-quobyte-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4" released by "delete_volume" :: held 0.776s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:16 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Created reservations ['970e3bca-ace7-4d40-a488-1b94452d8dc8', '2fe7fc6a-dc4a-4cc5-9f2e-dafffdc7538a', '9d781877-9ea1-49dd-aa16-e50bc3c96caf', '818dc7a9-8a67-4e9a-a912-5f12d36fa3c8'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:07:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:07:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:07:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:07:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.181s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:16 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:07:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Deleted volume successfully.
Sep 10 20:07:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "cinder-2aa657b9-4110-424f-867e-39f9dc438f6a-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-aef15dfb-e879-478e-96b6-4926cef23de8 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-0feaaefb-3bdb-4b8f-9a7a-28a3e56857e4-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-2aa657b9-4110-424f-867e-39f9dc438f6a-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:17 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:07:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "cinder-quobyte-2aa657b9-4110-424f-867e-39f9dc438f6a" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-quobyte-2aa657b9-4110-424f-867e-39f9dc438f6a" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:17 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e96475f-28e0-4953-931b-2e60ede43ea7]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:07:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2aa657b9-4110-424f-867e-39f9dc438f6a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:17 devstack quobyte-client[82855]: System call of process 100771 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 20:07:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2aa657b9-4110-424f-867e-39f9dc438f6a" returned: 0 in 0.524s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2aa657b9-4110-424f-867e-39f9dc438f6a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-2aa657b9-4110-424f-867e-39f9dc438f6a" returned: 0 in 0.172s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-quobyte-2aa657b9-4110-424f-867e-39f9dc438f6a" released by "delete_volume" :: held 0.990s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:18 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Created reservations ['c04160d1-fb9e-4cc9-aa22-01f57ca06976', '96a42688-e6c9-4e4a-ba6e-04ad3e95a113', '581f14e4-d42b-4fce-8825-c5e71514e857', '9a4d70ac-b3de-4aff-9477-6016fa8c7930'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:07:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:07:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:07:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:07:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.137s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:19 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:07:19 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Deleted volume successfully.
Sep 10 20:07:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cbbcd4b3-c68b-4004-b832-a2f1e77731cc tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-2aa657b9-4110-424f-867e-39f9dc438f6a-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "cinder-fa6b5610-b118-434e-ad80-d28185e73fbc-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-fa6b5610-b118-434e-ad80-d28185e73fbc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:19 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:07:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "cinder-quobyte-fa6b5610-b118-434e-ad80-d28185e73fbc" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-quobyte-fa6b5610-b118-434e-ad80-d28185e73fbc" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:19 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f99378-53b8-495a-8658-07158deb7123]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:07:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fa6b5610-b118-434e-ad80-d28185e73fbc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fa6b5610-b118-434e-ad80-d28185e73fbc" returned: 0 in 0.535s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fa6b5610-b118-434e-ad80-d28185e73fbc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-fa6b5610-b118-434e-ad80-d28185e73fbc" returned: 0 in 0.101s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-quobyte-fa6b5610-b118-434e-ad80-d28185e73fbc" released by "delete_volume" :: held 0.841s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:20 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Created reservations ['5b6cd6b6-4e7a-4524-aa22-88677d5ede0f', 'f8c09e02-edf7-4b3e-bbe7-82c3c9964992', '19f165b7-3eba-4673-8599-415d4afa73e6', '2a42f0bd-a996-40ce-880f-d713ba39a248'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:07:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:07:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:07:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:07:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.166s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:21 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:07:21 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Deleted volume successfully.
Sep 10 20:07:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ff04a56d-6a64-486a-abd2-dc88c34e3c7a tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-fa6b5610-b118-434e-ad80-d28185e73fbc-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "cinder-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:22 devstack cinder-volume[82850]: WARNING cinder.volume.volume_utils [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 20:07:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "cinder-quobyte-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 20:07:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-quobyte-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 20:07:22 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[70391ace-e184-41ea-84ac-fa1f0bc005be]: (4, 'qcow2') {{(pid=83899) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 20:07:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3" returned: 0 in 0.650s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "rm -f /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba/volume-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3" returned: 0 in 0.195s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-quobyte-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3" released by "delete_volume" :: held 1.061s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:23 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Created reservations ['d0a95db3-cd6a-4a2e-bbe8-7eb924fd82db', '7eea5689-316c-4a71-838b-38d3215d2dcd', 'ccc1fcd9-16e6-43be-8081-dc19f444f6aa', '52753082-37f6-4c27-83f6-b47e303c3240'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 20:07:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 20:07:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 20:07:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 20:07:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Available shares ['10.10.41.181/cinder-vol-54cd9c7b-7819-419b-a30e-2c7b91db8b1a'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 20:07:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 20:07:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 20:07:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/22abb21c07a867ee97c80021fbff3aba" returned: 0 in 0.136s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 20:07:24 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 20:07:24 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Deleted volume successfully.
Sep 10 20:07:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-22c9ad5f-af66-43c0-a574-c9f3efb7e4d0 tempest-CreateVolumesFromSourceVolumeTest-1247848968 None] Lock "cinder-dfdf5b0f-db06-4503-bafe-98bb47dd6fc3-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 20:07:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=95,cinder:INSERT=22,cinder:UPDATE=139,cinder:DELETE=12 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 20:07:34 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=70,cinder:INSERT=34,cinder:UPDATE=114,cinder:DELETE=10 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}